Orbiter History

Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 186084 reports (Page 111 of 3722)

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.....................................................XXX....] duration: 2.080249667s trace: https://jaeger.dev.storj.io/trace/4d18ebf192707efc FAIL (2025-12-10 23:29:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.080351137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................................................XXX.....] duration: 2.853171398s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:29:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.853194834s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 1m0.116051131s trace: https://jaeger.dev.storj.io/trace/362e74c24b5bf7c1 FAIL (2025-12-10 23:29:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 25 (128h0m4.408745666s) [seg_pos={0 0}, upload=112515]: Done begin upload segment. Dec 10 23:28:24.428441597 (128h0m4.408794243s) [noise=true , address=45.91.116.7:4017 , piece_id=VM5Z24MQ5QAD7SP2XZFK35MTTLBIBEAPCPB7R32A5N4HYWELOE3Q, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.428507340 (128h0m4.408859979s) [noise=true , address=77.90.31.17:4780 , piece_id=GDCPG4KLIVZV23V2P5DA4VWV2AMRZAOBAS4BISUNMKO6SJFZUPSQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.429095275 (128h0m4.409447915s) [noise=true , address=77.90.31.12:4607 , piece_id=OKSWYRAULHYK4BGRWWJVHCBYXFNAP25RSRSDU62K42MGV3OMI4EQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.429460502 (128h0m4.409813151s) [noise=true , address=5.231.73.4:4015 , piece_id=76RETWNH356B2VWNX2B5QWOMHFDHCYWI7H6FUHWPFY2ZMQULYEBQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.429824725 (128h0m4.410177396s) [noise=true , address=145.79.227.4:4214 , piece_id=2WXZGICVFTPM3IHDTHXAHED2KR6BWDZFUIOBJA7HS7KRNSFZ5PRA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.430119224 (128h0m4.410471862s) [noise=true , address=45.91.116.9:4283 , piece_id=SND4JY7WQNKNN7HASMTTQHEIHRP77K444TDQWXJKVJWKBJZEXJZA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.430386043 (128h0m4.410738684s) [noise=true , address=77.90.31.10:4545 , piece_id=I5J6P75SGCQR3S3DBBMQIPPAYBLJEB6QRWVXKCXMBLGPIL2U3AOQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.430660101 (128h0m4.411012739s) [noise=true , address=45.91.116.5:4322 , piece_id=4ADYHXCKHTT6Y4Z5UN4VH6XKX2RG4TTJHI3C5LVC6Z6DS5KAS2OQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.430737937 (128h0m4.411090575s) [noise=true , address=77.90.31.18:4828 , piece_id=3WYYU5URLMQ4BWZNYBPJCH4IZYNUDEF7N5ERBHAMRC2K3IDQTNKQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.431119035 (128h0m4.411471684s) [noise=true , address=77.90.31.16:4738 , piece_id=NFZPHY2AJCC33TS5HB7GQAN2KTDXZDEMYSLB2AD4MHOWBSK5HCMA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.431223198 (128h0m4.411575845s) [noise=true , address=145.79.227.34:4917 , piece_id=Y4CFRU5NEFNINCU3T44EYXMPPII7LQXX372JQY3YUETSNOYULLFA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.431505626 (128h0m4.411858273s) [noise=true , address=5.231.73.5:4013 , piece_id=SJJJYVXC3SOP3QRUIY4SQJE5EAWG35GC5LVARRKIRR5V7PFSLDLA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.431846829 (128h0m4.412199473s) [noise=true , address=77.90.31.19:4871 , piece_id=5R6UX4PDA7H3NFFHZYQIAOIGZWGHWJP6V4FH6U6BODVUDV5THYMQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.431985926 (128h0m4.412338566s) [noise=true , address=145.79.227.21:4484 , piece_id=VJY2MAH47LFH6PPLKCQD5AQVLUGJP5BJVNV6GKGQXSKRENBEUQPA, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.432353066 (128h0m4.412705714s) [noise=true , address=77.90.31.15:4714 , piece_id=PR225QHF72INMPNO5UZPSJFTJFS3FBLGFSZXLG3XMOJXSMCVWQEQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.432415999 (128h0m4.412768638s) [noise=true , address=45.91.116.11:4149 , piece_id=T67OKPNKEAHLMOQDICS6ZVULYXFBIZV26ZRJLBNIUPFQCOEC6HZQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.432978359 (128h0m4.413330996s) [noise=true , address=145.79.227.22:4528 , piece_id=CDBKTISZ2FXXXGOIQODQXBV45MARW4IMCPEVWCTPUDR4BVZNFJAQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.433604909 (128h0m4.413957547s) [noise=true , address=145.79.227.31:4803 , piece_id=ZEAINMZK2MITOPASNZ6FXLOEC6I7PHCOP6FBWKZNPZ57WEHXFXIQ, seg_pos={0 0}, upload=112515]: Uploading piece... Dec 10 23:28:24.986170062 (128h0m4.966522699s) [upload=112515]: Next returned nil segment Dec 10 23:28:24.986184369 (128h0m4.966537005s) [upload=112515]: Waiting for error group managing segments... Dec 10 23:28:25.130334345 (128h0m5.110686988s) [noise=true , address=45.91.116.9:4283 , piece_id=SND4JY7WQNKNN7HASMTTQHEIHRP77K444TDQWXJKVJWKBJZEXJZA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.131623010 (128h0m5.111975655s) [noise=true , address=145.79.227.34:4917 , piece_id=Y4CFRU5NEFNINCU3T44EYXMPPII7LQXX372JQY3YUETSNOYULLFA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.135104533 (128h0m5.11545717s) [noise=true , address=145.79.227.22:4528 , piece_id=CDBKTISZ2FXXXGOIQODQXBV45MARW4IMCPEVWCTPUDR4BVZNFJAQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.139242769 (128h0m5.119595407s) [noise=true , address=145.79.227.4:4214 , piece_id=2WXZGICVFTPM3IHDTHXAHED2KR6BWDZFUIOBJA7HS7KRNSFZ5PRA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.142896687 (128h0m5.123249328s) [noise=true , address=145.79.227.31:4803 , piece_id=ZEAINMZK2MITOPASNZ6FXLOEC6I7PHCOP6FBWKZNPZ57WEHXFXIQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.149308830 (128h0m5.129661474s) [noise=true , address=45.91.116.7:4017 , piece_id=VM5Z24MQ5QAD7SP2XZFK35MTTLBIBEAPCPB7R32A5N4HYWELOE3Q, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.150661573 (128h0m5.131014221s) [noise=true , address=45.91.116.11:4149 , piece_id=T67OKPNKEAHLMOQDICS6ZVULYXFBIZV26ZRJLBNIUPFQCOEC6HZQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.154358681 (128h0m5.134711324s) [noise=true , address=45.91.116.5:4322 , piece_id=4ADYHXCKHTT6Y4Z5UN4VH6XKX2RG4TTJHI3C5LVC6Z6DS5KAS2OQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.155124542 (128h0m5.135477182s) [noise=true , address=145.79.227.21:4484 , piece_id=VJY2MAH47LFH6PPLKCQD5AQVLUGJP5BJVNV6GKGQXSKRENBEUQPA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.334111846 (128h0m5.314464483s) [noise=true , address=5.231.73.4:4015 , piece_id=76RETWNH356B2VWNX2B5QWOMHFDHCYWI7H6FUHWPFY2ZMQULYEBQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:28:25.364778480 (128h0m5.345131116s) [noise=true , address=5.231.73.5:4013 , piece_id=SJJJYVXC3SOP3QRUIY4SQJE5EAWG35GC5LVARRKIRR5V7PFSLDLA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: <nil> Dec 10 23:29:24.036092889 (128h1m4.016445534s) [noise=true , address=77.90.31.18:4828 , piece_id=3WYYU5URLMQ4BWZNYBPJCH4IZYNUDEF7N5ERBHAMRC2K3IDQTNKQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:1jwTDXPShXfNdfMx3UXi22gQphBpFre1MhRsHyjq6xRz4wwTr9, address:77.90.31.18:4828): protocol: rpc: dial tcp 77.90.31.18:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.036267706 (128h1m4.016620349s) [noise=true , address=77.90.31.17:4780 , piece_id=GDCPG4KLIVZV23V2P5DA4VWV2AMRZAOBAS4BISUNMKO6SJFZUPSQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:1XfvmVdBudtFnKwNxCxuGbQMS6HSSkVwPkYmffa5X6e6uYNcuF, address:77.90.31.17:4780): protocol: write tcp 139.59.144.22:48326->77.90.31.17:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.036410839 (128h1m4.016763477s) [noise=true , address=77.90.31.12:4607 , piece_id=OKSWYRAULHYK4BGRWWJVHCBYXFNAP25RSRSDU62K42MGV3OMI4EQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:12UYNy47GZEha8wG9vZNUAws5ogTBjSXLdt7T2bwqcHGsPrKFrm, address:77.90.31.12:4607): protocol: write tcp 139.59.144.22:57322->77.90.31.12:4607: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.037031339 (128h1m4.017383984s) [noise=true , address=77.90.31.16:4738 , piece_id=NFZPHY2AJCC33TS5HB7GQAN2KTDXZDEMYSLB2AD4MHOWBSK5HCMA, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: rpc: dial tcp 77.90.31.16:4738: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.037279115 (128h1m4.017631757s) [noise=true , address=77.90.31.15:4714 , piece_id=PR225QHF72INMPNO5UZPSJFTJFS3FBLGFSZXLG3XMOJXSMCVWQEQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP, address:77.90.31.15:4714): protocol: write tcp 139.59.144.22:60956->77.90.31.15:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.037742547 (128h1m4.018095193s) [noise=true , address=77.90.31.19:4871 , piece_id=5R6UX4PDA7H3NFFHZYQIAOIGZWGHWJP6V4FH6U6BODVUDV5THYMQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:12hrM59APBvzYUrwWMvSUQVMSkzNPxaNFDWEZn2J96xYTdv4Ezm, address:77.90.31.19:4871): protocol: rpc: dial tcp 77.90.31.19:4871: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.037833526 (128h1m4.018186168s) [noise=true , address=77.90.31.10:4545 , piece_id=I5J6P75SGCQR3S3DBBMQIPPAYBLJEB6QRWVXKCXMBLGPIL2U3AOQ, seg_pos={0 0}, upload=112515]: Done uploading piece. err: ecclient: upload failed (node:1ZFFijCUFET1ShEJuav6uAzFhfraCEcr6seuySYN9ipn4wsZGX, address:77.90.31.10:4545): protocol: write tcp 139.59.144.22:37646->77.90.31.10:4545: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:29:24.037874132 (128h1m4.018226758s) [seg_pos={0 0}, upload=112515]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Dec 10 23:29:24.149743373 (128h1m4.130096009s) [upload=112515]: Done uploading segments... Dec 10 23:29:24.149774622 (128h1m4.130127262s) [upload=112515]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.116083477s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................................................XXX...] duration: 1.637430797s trace: https://jaeger.dev.storj.io/trace/4d18ebf192707efc FAIL (2025-12-10 23:28:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.637543695s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................XXX....] duration: 2.665134466s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:28:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.665156301s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 1m0.111682151s trace: https://jaeger.dev.storj.io/trace/3e5c8ca937141607 FAIL (2025-12-10 23:28:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== segments... Dec 10 23:27:17.949451259 (127h58m57.929803899s) [upload=112496]: Got next segment. Inline: false Dec 10 23:27:17.949551902 (127h58m57.929904539s) [upload=112496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 10 23:27:17.949558906 (127h58m57.929911546s) [upload=112496]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 10 23:27:18.059724731 (127h58m58.040077368s) [seg_pos={0 0}, upload=112496]: Begin upload segment... Dec 10 23:27:18.059811387 (127h58m58.040164027s) [seg_pos={0 0}, upload=112496]: Done begin upload segment. Dec 10 23:27:18.059857324 (127h58m58.040209967s) [noise=true , address=77.90.31.12:4613 , piece_id=4DFUQHEFKZSVX7TTD6BAXFFFDCGKFXC2BHGMHIOIPSHZLRIGSDXQ, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.060545238 (127h58m58.040897886s) [noise=true , address=145.79.227.46:4610 , piece_id=JRMWCIWIPLM6ELR3IC2PKI74RWGB2DIWUIHCFESIV5VRFROIGYHA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.061060322 (127h58m58.041412959s) [noise=true , address=145.79.227.50:4397 , piece_id=AIB4ILWINNIY25BG7BLP7O4N5NMOAYCFGTZKEXQVJIXRSNQB2C7A, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.061103756 (127h58m58.041456394s) [noise=true , address=145.79.227.21:4501 , piece_id=ETVIKXXAGG42PMHWFRVV4RRC5FF7DJRD5A3KFVBVYBIUBNKAVCVA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.061712724 (127h58m58.042065368s) [noise=true , address=77.90.31.21:4892 , piece_id=6LOSQNYZKM27ML7O7GW7HKPNL73VWBADSESFN7H7PZUB7WYKZIZA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.061731868 (127h58m58.042084508s) [noise=true , address=45.91.116.5:4306 , piece_id=GADG2V2LQHIFN3S2EZX75HZ6OFILMSV7JQSACRL4JKNIQOW5BMFQ, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.062257073 (127h58m58.042609725s) [noise=true , address=5.231.73.4:4027 , piece_id=CPXTL5ZTY3ZYB2B2AX2M4V45XCNRJVZZLV3ITVZJZEEPQ6QXAFHA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.062269096 (127h58m58.042621744s) [noise=true , address=145.79.227.12:4779 , piece_id=EOPMBLF3CIYLWKHHMKVHV6E7TFWDBOUFYI6LOFTNFT6W4RR7UQ7A, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.062344020 (127h58m58.042696668s) [noise=true , address=145.79.227.30:4766 , piece_id=VI3ZCWJP4AJSVJZDCAE3TVRWTR2FZ3KVW6HDEXBRR5GHUH7ABRIA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.062838347 (127h58m58.043190987s) [noise=true , address=77.90.31.15:4720 , piece_id=J7TTVCMRVKEVGBYMBEY5SNRQLUSUYIFKP43G3CIYWITMG2WMUAEA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.062870072 (127h58m58.043222717s) [noise=true , address=77.90.31.19:4852 , piece_id=7S2DV75PHNADTVILJ2FVCUL7HBJWXCPOAFEGYGUHVQMHQEBOSWTQ, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.063311721 (127h58m58.04366437s) [noise=true , address=45.91.116.12:4246 , piece_id=SI4CFDUV53Y6WS4AARTXHUTQZZFFEOHSSKY6YYJDL2EFARPBT2QA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.063389540 (127h58m58.043742185s) [noise=true , address=45.91.116.7:4035 , piece_id=7RRGGWZWNUFVYI2NCMLN3F2TMMIXJDAP5WVLQLFTE2FS5TVTADRA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.063838637 (127h58m58.044191275s) [noise=true , address=45.91.116.7:4039 , piece_id=CJGN4MS5KRXUCXOSGO4TFLORXU4JHAFSMHDTDDPA2DKAW3QILMNA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.064272410 (127h58m58.044625111s) [noise=true , address=45.91.116.10:4093 , piece_id=CAJDY455SU7GYRPQNXIQXVEOJBEXDZVFYK7WJXY63PJTIZVDU4HQ, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.064758164 (127h58m58.045110802s) [noise=true , address=77.90.31.14:4665 , piece_id=HKQ3XHGK5UQ76Z6BS4KMIVZ33AZB74RTFEPLNQURRNQIMBTJAOUA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.065583206 (127h58m58.045935837s) [noise=true , address=5.231.73.2:4019 , piece_id=NIIUIV3ZPCMIOOCZHTCPPMNNTMVH4I7GDVYJORMV2NTAT4EM2OQQ, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.066988982 (127h58m58.047341628s) [noise=true , address=5.231.73.5:4003 , piece_id=VZK3LBFVBM7XKCWFQL7TFGTCYCIGECRBIG24MUVPACHAEEZ42UQA, seg_pos={0 0}, upload=112496]: Uploading piece... Dec 10 23:27:18.612725638 (127h58m58.593078265s) [upload=112496]: Next returned nil segment Dec 10 23:27:18.612759963 (127h58m58.593112602s) [upload=112496]: Waiting for error group managing segments... Dec 10 23:27:18.759477141 (127h58m58.739829777s) [noise=true , address=145.79.227.46:4610 , piece_id=JRMWCIWIPLM6ELR3IC2PKI74RWGB2DIWUIHCFESIV5VRFROIGYHA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.760535685 (127h58m58.740888322s) [noise=true , address=145.79.227.21:4501 , piece_id=ETVIKXXAGG42PMHWFRVV4RRC5FF7DJRD5A3KFVBVYBIUBNKAVCVA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.760917628 (127h58m58.741270265s) [noise=true , address=45.91.116.10:4093 , piece_id=CAJDY455SU7GYRPQNXIQXVEOJBEXDZVFYK7WJXY63PJTIZVDU4HQ, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.762146547 (127h58m58.742499188s) [noise=true , address=145.79.227.12:4779 , piece_id=EOPMBLF3CIYLWKHHMKVHV6E7TFWDBOUFYI6LOFTNFT6W4RR7UQ7A, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.773076331 (127h58m58.753428973s) [noise=true , address=45.91.116.12:4246 , piece_id=SI4CFDUV53Y6WS4AARTXHUTQZZFFEOHSSKY6YYJDL2EFARPBT2QA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.776623655 (127h58m58.75697628s) [noise=true , address=45.91.116.5:4306 , piece_id=GADG2V2LQHIFN3S2EZX75HZ6OFILMSV7JQSACRL4JKNIQOW5BMFQ, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.779585833 (127h58m58.759938469s) [noise=true , address=145.79.227.50:4397 , piece_id=AIB4ILWINNIY25BG7BLP7O4N5NMOAYCFGTZKEXQVJIXRSNQB2C7A, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.782860573 (127h58m58.763213213s) [noise=true , address=45.91.116.7:4039 , piece_id=CJGN4MS5KRXUCXOSGO4TFLORXU4JHAFSMHDTDDPA2DKAW3QILMNA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.795161601 (127h58m58.775514246s) [noise=true , address=45.91.116.7:4035 , piece_id=7RRGGWZWNUFVYI2NCMLN3F2TMMIXJDAP5WVLQLFTE2FS5TVTADRA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.934266039 (127h58m58.914618687s) [noise=true , address=5.231.73.2:4019 , piece_id=NIIUIV3ZPCMIOOCZHTCPPMNNTMVH4I7GDVYJORMV2NTAT4EM2OQQ, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.962731376 (127h58m58.943084019s) [noise=true , address=5.231.73.4:4027 , piece_id=CPXTL5ZTY3ZYB2B2AX2M4V45XCNRJVZZLV3ITVZJZEEPQ6QXAFHA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:18.973499495 (127h58m58.953852131s) [noise=true , address=5.231.73.5:4003 , piece_id=VZK3LBFVBM7XKCWFQL7TFGTCYCIGECRBIG24MUVPACHAEEZ42UQA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:27:19.735041209 (127h58m59.715393849s) [noise=true , address=145.79.227.30:4766 , piece_id=VI3ZCWJP4AJSVJZDCAE3TVRWTR2FZ3KVW6HDEXBRR5GHUH7ABRIA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: <nil> Dec 10 23:28:17.666820224 (127h59m57.647172869s) [noise=true , address=77.90.31.14:4665 , piece_id=HKQ3XHGK5UQ76Z6BS4KMIVZ33AZB74RTFEPLNQURRNQIMBTJAOUA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: ecclient: upload failed (node:12W4n6uf6azQk1QgeR8Xw7UkpnZm19zdyFKwojCsqZt2GFHrpce, address:77.90.31.14:4665): protocol: rpc: dial tcp 77.90.31.14:4665: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:28:17.667220243 (127h59m57.647572888s) [noise=true , address=77.90.31.21:4892 , piece_id=6LOSQNYZKM27ML7O7GW7HKPNL73VWBADSESFN7H7PZUB7WYKZIZA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: ecclient: upload failed (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa, address:77.90.31.21:4892): protocol: rpc: dial tcp 77.90.31.21:4892: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:28:17.667622451 (127h59m57.647975097s) [noise=true , address=77.90.31.15:4720 , piece_id=J7TTVCMRVKEVGBYMBEY5SNRQLUSUYIFKP43G3CIYWITMG2WMUAEA, seg_pos={0 0}, upload=112496]: Done uploading piece. err: ecclient: upload failed (node:12VbsxFqMB3vVphSAJqYpbBzua7Goq45E6ovJSaExkpLtfkcc74, address:77.90.31.15:4720): protocol: rpc: dial tcp 77.90.31.15:4720: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:28:17.667791799 (127h59m57.648144445s) [noise=true , address=77.90.31.19:4852 , piece_id=7S2DV75PHNADTVILJ2FVCUL7HBJWXCPOAFEGYGUHVQMHQEBOSWTQ, seg_pos={0 0}, upload=112496]: Done uploading piece. err: ecclient: upload failed (node:1UVCFqkZwuXQ28GdfQahRcC5jwfWhoanWdTs7Z1jdHkxVVDARi, address:77.90.31.19:4852): protocol: rpc: dial tcp 77.90.31.19:4852: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:28:17.668012775 (127h59m57.648365418s) [noise=true , address=77.90.31.12:4613 , piece_id=4DFUQHEFKZSVX7TTD6BAXFFFDCGKFXC2BHGMHIOIPSHZLRIGSDXQ, seg_pos={0 0}, upload=112496]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:44298->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:28:17.668049853 (127h59m57.648402492s) [seg_pos={0 0}, upload=112496]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Dec 10 23:28:17.776250492 (127h59m57.756603132s) [upload=112496]: Done uploading segments... Dec 10 23:28:17.776301073 (127h59m57.756653712s) [upload=112496]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.111700399s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................................................XXX...] duration: 3.505156951s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:27:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.505189862s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.......................................................XXX..] duration: 1.709097977s trace: https://jaeger.dev.storj.io/trace/4d18ebf192707efc FAIL (2025-12-10 23:27:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.709124318s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.11328204s trace: https://jaeger.dev.storj.io/trace/67ec657f9779ddd7 FAIL (2025-12-10 23:27:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== d=112483]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 10 23:26:17.699952441 (127h57m57.680305067s) [upload=112483]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 10 23:26:17.812422944 (127h57m57.792775586s) [seg_pos={0 0}, upload=112483]: Begin upload segment... Dec 10 23:26:17.812468935 (127h57m57.792821572s) [seg_pos={0 0}, upload=112483]: Done begin upload segment. Dec 10 23:26:17.812493498 (127h57m57.792846134s) [noise=true , address=145.79.227.16:4920 , piece_id=FEG6SLBY5HUBBVOBCQZ3H2DSNJC2TDN4V6OCJZCEUCXRVWYBLQAQ, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.813533521 (127h57m57.793886163s) [noise=true , address=77.90.31.19:4868 , piece_id=VQ3TFLB5Z7UNYUHZ5RG6HXMZK2BN6ICHGS2N5OMW3FY4DWARTXMQ, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.814215446 (127h57m57.794568087s) [noise=true , address=77.90.31.18:4837 , piece_id=BHYP7GE6Y344CICIAKFO4KACOJPBWW7ETATWZZB2Z7QYM6L2DNHQ, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.814772400 (127h57m57.79512504s) [noise=true , address=193.149.164.143:4700 , piece_id=F5NPK7BORDVIHOTMNCO5PWJNQ65LPMLX6IAUSR4P3U5RRVBCRX3A, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.815375506 (127h57m57.795728156s) [noise=true , address=145.79.227.23:4560 , piece_id=C2UVHN3KX7L35A22B7EN5TT74SW5J7MCSG4LG75C2CKKOPYQTZMQ, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.816031588 (127h57m57.796384288s) [noise=true , address=77.90.31.15:4701 , piece_id=G4UE73F6VYHXTDNBAGFEABGAOTB7OVOCXNPDNZAG2JOBBDQRPVOA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.816649407 (127h57m57.797002043s) [noise=true , address=77.90.31.14:4695 , piece_id=WL2CGSPENNDFPTXOS4BDLQPO3HUEKTX3OZ4XYP7YUUWY3VB6IYLA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.817298225 (127h57m57.797650866s) [noise=true , address=145.79.227.33:4874 , piece_id=AFOJVY27Y2L3KZ6AAFYYEOMQAL7P5GYYSL5CJSA2FA6WQHXVX2JA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.817779553 (127h57m57.798132192s) [noise=true , address=145.79.227.30:4785 , piece_id=LEULWNTOPPUECZVVJX2BYPWPUZ6J3JYEJD5PLEBMD72ID7SVC5EA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.818292737 (127h57m57.798645373s) [noise=true , address=45.91.116.10:4109 , piece_id=S4JKZT5ZQA2ZLIW4NK3UKS4Z7RO7BWCMXJR4EJKGQSZSFF27DZMA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.818760975 (127h57m57.799113611s) [noise=true , address=45.91.116.4:4965 , piece_id=HMCHR6TTB3AXL7XXOWBY5SVQLKTKOGRW2BDV6WGOSD6RHOU5LV7A, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.819271715 (127h57m57.799624351s) [noise=true , address=77.90.31.12:4605 , piece_id=7VHX54S3X2ONWZWGIL2WHHBABQB7A7IJ5LBH7TWTNG5L32ZQL27Q, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.819853393 (127h57m57.800206029s) [noise=true , address=145.79.227.48:4321 , piece_id=6B2RJFAPUC2ZPGJ3FMPXHQCWV34BOSQTRUYOUOHFRHQC3CFNDP3Q, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.820510522 (127h57m57.800863161s) [noise=true , address=77.90.31.15:4716 , piece_id=FWKREXPNUFP7G6JKZZ7F2DMEJSJDKPVZYJHKJMR2X2MYYVZC6X6Q, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.821048766 (127h57m57.801401402s) [noise=true , address=145.79.227.38:4984 , piece_id=JJXLRR2CWIMLTBMGGTKLVGRAINRABUNEFMH346QFVWLTLOEAH5BQ, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.821720130 (127h57m57.802072778s) [noise=true , address=145.79.227.28:4752 , piece_id=XHVY3W4OQRGMJHUYKB7UZRLFDOZIOBXHFGXDKHZCAAHV67ASEOPA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.822422023 (127h57m57.80277467s) [noise=true , address=77.90.31.16:4759 , piece_id=DKEC7A2FK6LKRHVSJT6JCEPDBMCCOCOY2TX5ANPJI7XSY6UAABCA, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:17.823187110 (127h57m57.80353975s) [noise=true , address=145.79.227.7:4298 , piece_id=S5XFJ4TXXCEU33FQRLIJZQDWYB4TV7DVGHKCMKIRKKBFT5Z63J7Q, seg_pos={0 0}, upload=112483]: Uploading piece... Dec 10 23:26:18.344216748 (127h57m58.324569373s) [upload=112483]: Next returned nil segment Dec 10 23:26:18.344233854 (127h57m58.324586493s) [upload=112483]: Waiting for error group managing segments... Dec 10 23:26:18.517572389 (127h57m58.497925025s) [noise=true , address=145.79.227.7:4298 , piece_id=S5XFJ4TXXCEU33FQRLIJZQDWYB4TV7DVGHKCMKIRKKBFT5Z63J7Q, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.519007214 (127h57m58.49935985s) [noise=true , address=145.79.227.48:4321 , piece_id=6B2RJFAPUC2ZPGJ3FMPXHQCWV34BOSQTRUYOUOHFRHQC3CFNDP3Q, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.520747378 (127h57m58.501100015s) [noise=true , address=45.91.116.4:4965 , piece_id=HMCHR6TTB3AXL7XXOWBY5SVQLKTKOGRW2BDV6WGOSD6RHOU5LV7A, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.522039124 (127h57m58.502391746s) [noise=true , address=145.79.227.33:4874 , piece_id=AFOJVY27Y2L3KZ6AAFYYEOMQAL7P5GYYSL5CJSA2FA6WQHXVX2JA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.523649340 (127h57m58.504001977s) [noise=true , address=145.79.227.38:4984 , piece_id=JJXLRR2CWIMLTBMGGTKLVGRAINRABUNEFMH346QFVWLTLOEAH5BQ, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.535505200 (127h57m58.51585784s) [noise=true , address=145.79.227.28:4752 , piece_id=XHVY3W4OQRGMJHUYKB7UZRLFDOZIOBXHFGXDKHZCAAHV67ASEOPA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.535762980 (127h57m58.516115623s) [noise=true , address=45.91.116.10:4109 , piece_id=S4JKZT5ZQA2ZLIW4NK3UKS4Z7RO7BWCMXJR4EJKGQSZSFF27DZMA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:18.558854865 (127h57m58.539207491s) [noise=true , address=145.79.227.23:4560 , piece_id=C2UVHN3KX7L35A22B7EN5TT74SW5J7MCSG4LG75C2CKKOPYQTZMQ, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:19.112255478 (127h57m59.092608151s) [noise=true , address=193.149.164.143:4700 , piece_id=F5NPK7BORDVIHOTMNCO5PWJNQ65LPMLX6IAUSR4P3U5RRVBCRX3A, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:19.502493351 (127h57m59.482845988s) [noise=true , address=145.79.227.16:4920 , piece_id=FEG6SLBY5HUBBVOBCQZ3H2DSNJC2TDN4V6OCJZCEUCXRVWYBLQAQ, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:26:19.664420098 (127h57m59.644772738s) [noise=true , address=145.79.227.30:4785 , piece_id=LEULWNTOPPUECZVVJX2BYPWPUZ6J3JYEJD5PLEBMD72ID7SVC5EA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: <nil> Dec 10 23:27:17.411378013 (127h58m57.391730653s) [noise=true , address=77.90.31.19:4868 , piece_id=VQ3TFLB5Z7UNYUHZ5RG6HXMZK2BN6ICHGS2N5OMW3FY4DWARTXMQ, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:17DGGjPv2UkSCAH8ihb4U7CX2K5mYmPjumSSKc26sbcscrjQX1, address:77.90.31.19:4868): protocol: write tcp 139.59.144.22:46172->77.90.31.19:4868: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:27:17.411419873 (127h58m57.391772522s) [noise=true , address=77.90.31.15:4701 , piece_id=G4UE73F6VYHXTDNBAGFEABGAOTB7OVOCXNPDNZAG2JOBBDQRPVOA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6, address:77.90.31.15:4701): protocol: rpc: dial tcp 77.90.31.15:4701: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:27:17.411685831 (127h58m57.392038504s) [noise=true , address=77.90.31.18:4837 , piece_id=BHYP7GE6Y344CICIAKFO4KACOJPBWW7ETATWZZB2Z7QYM6L2DNHQ, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:12YfSnynVtsWn1XtXHGeik1vUgqzRtArmEJJrWcXd23m2yUTS8j, address:77.90.31.18:4837): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:27:17.411842297 (127h58m57.392194939s) [noise=true , address=77.90.31.14:4695 , piece_id=WL2CGSPENNDFPTXOS4BDLQPO3HUEKTX3OZ4XYP7YUUWY3VB6IYLA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:27:17.411989566 (127h58m57.392342208s) [noise=true , address=77.90.31.12:4605 , piece_id=7VHX54S3X2ONWZWGIL2WHHBABQB7A7IJ5LBH7TWTNG5L32ZQL27Q, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53, address:77.90.31.12:4605): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:27:17.412139385 (127h58m57.392492024s) [noise=true , address=77.90.31.16:4759 , piece_id=DKEC7A2FK6LKRHVSJT6JCEPDBMCCOCOY2TX5ANPJI7XSY6UAABCA, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE, address:77.90.31.16:4759): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:27:17.412187222 (127h58m57.392539851s) [noise=true , address=77.90.31.15:4716 , piece_id=FWKREXPNUFP7G6JKZZ7F2DMEJSJDKPVZYJHKJMR2X2MYYVZC6X6Q, seg_pos={0 0}, upload=112483]: Done uploading piece. err: ecclient: upload failed (node:12tuEGhEzrpo1eV7v2QatHXHMy7b1S5gcVSymWYWJSoCFUMGnaL, address:77.90.31.15:4716): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:27:17.412223043 (127h58m57.392575668s) [seg_pos={0 0}, upload=112483]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Dec 10 23:27:17.522269654 (127h58m57.502622309s) [upload=112483]: Done uploading segments... Dec 10 23:27:17.522327373 (127h58m57.502680016s) [upload=112483]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.113296319s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........................................................XXX.] duration: 1.702159257s trace: https://jaeger.dev.storj.io/trace/4d18ebf192707efc FAIL (2025-12-10 23:26:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.702180948s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................XXX..] duration: 2.800651585s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:26:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.800720988s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.113606669s trace: https://jaeger.dev.storj.io/trace/572c6bf5746d8a4a FAIL (2025-12-10 23:26:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== IFDILHAGMKLI2BXVJKMUHLA24HK7UROLJ3HWNRYMTWOV5QQA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.577531270 (127h56m57.557883909s) [noise=true , address=77.90.31.10:4523 , piece_id=USTCUT5TMG63OSDNDFXP7QWKZGAHGBEXZWUOFQLQMSY6WFPRP2FA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.578098100 (127h56m57.55845074s) [noise=true , address=45.91.116.7:4027 , piece_id=FKDDNLWZ6ORDU7BDVEDMKGPKWQUSPGJI4AVRITQ5MYSTZHWV32QA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.578522660 (127h56m57.558875284s) [noise=true , address=145.79.227.28:4746 , piece_id=BBITBBMJVXHPGA525Z2FVBNH3JWQJPYG6VJVY6HSKTXETZ7EHYFQ, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.578819758 (127h56m57.559172401s) [noise=true , address=145.79.227.11:4733 , piece_id=MPTGGCZ3APLVDZ55PDLUOV557NLCCW5THSV7U7WHNHVVHA75WSYA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.579367624 (127h56m57.559720265s) [noise=true , address=145.79.227.24:4590 , piece_id=MLFWCK6F3JP3ZINPBMGZARBDGBEQOI4EAIGUOFHFVLVOGTKM4VVA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.579807773 (127h56m57.560160411s) [noise=true , address=77.90.31.12:4594 , piece_id=B6YB7COA2IBHMHEHSNOHOJ4JW3NXTKGJ3AFI752HNPND47HKWH5Q, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.580229823 (127h56m57.560582464s) [noise=true , address=45.91.116.4:4960 , piece_id=UJV6XS6TELRHP6QQPUBO33MVSYEGQX67WOYFVQGXXFVTIQ4GDXOQ, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.581013951 (127h56m57.561366595s) [noise=true , address=77.90.31.15:4709 , piece_id=FKU6TV3E7MLXK77RPIOFAIWKRVQ2F2ITRTDGXX5VA4IF55NQBLXA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.581087579 (127h56m57.561440227s) [noise=true , address=77.90.31.16:4762 , piece_id=3Z44UXNPWIU3HODWONE5GLHSWVRNWS3ZGH4PQMFWWLS4ZIZ7FH3Q, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.582402633 (127h56m57.562755271s) [noise=true , address=45.91.116.11:4136 , piece_id=NG5C5HNJRTBLBPO2X2ODE25TYOTE7B3XE2MIHMXDQOLROROG6ZPA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.582462528 (127h56m57.562815166s) [noise=true , address=77.90.31.13:4654 , piece_id=MTEXSMCPQQUE6EVV4VIM3MZBEXMNNBWARS2BYYR6OSXQ6QSUOVFA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.582940413 (127h56m57.563293056s) [noise=true , address=45.91.116.12:4251 , piece_id=NOLM4RYYTHRHAQHG3YF337652CQFP5I5TQFR4OG7NUQYHTBEEEHA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.582965361 (127h56m57.56331801s) [noise=true , address=145.79.227.40:4066 , piece_id=O7RQ6C62GTFATP4CRBKUIFRVQ6O57DXDMQ4RAMBUSC5SB3KZUUPQ, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.583398741 (127h56m57.563751381s) [noise=true , address=145.79.227.33:4872 , piece_id=NC6D3ASYLAHMMMURRTOCN4IA3Y2QNXV44C6AEJ65FVMLZNQ2E5KA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.583484159 (127h56m57.563836795s) [noise=true , address=45.91.116.9:4278 , piece_id=LTT5IVZUCVIWT3S2EWZD2PYZVU4YLPP3RNR2QQIBWWKKCFEUZZZA, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.584075455 (127h56m57.564428092s) [noise=true , address=145.79.227.16:4938 , piece_id=P6JROZHXTG6LUHFSPBO4UTNSBG67OE56B3XMRSCYRCI25Y5FFJXQ, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:17.584585708 (127h56m57.564938345s) [noise=true , address=77.90.31.19:4848 , piece_id=FNOBYSAPIPNRUDOXPAQTVTG4RV6OE2ZJOPQ3V43FXLYQLZ3XJCQQ, seg_pos={0 0}, upload=112470]: Uploading piece... Dec 10 23:25:18.106107906 (127h56m58.086460548s) [upload=112470]: Next returned nil segment Dec 10 23:25:18.106125093 (127h56m58.08647774s) [upload=112470]: Waiting for error group managing segments... Dec 10 23:25:18.280876360 (127h56m58.261229003s) [noise=true , address=45.91.116.7:4027 , piece_id=FKDDNLWZ6ORDU7BDVEDMKGPKWQUSPGJI4AVRITQ5MYSTZHWV32QA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.282367463 (127h56m58.262720111s) [noise=true , address=145.79.227.24:4590 , piece_id=MLFWCK6F3JP3ZINPBMGZARBDGBEQOI4EAIGUOFHFVLVOGTKM4VVA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.284608412 (127h56m58.264961059s) [noise=true , address=45.91.116.11:4136 , piece_id=NG5C5HNJRTBLBPO2X2ODE25TYOTE7B3XE2MIHMXDQOLROROG6ZPA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.288667805 (127h56m58.269020445s) [noise=true , address=45.91.116.12:4251 , piece_id=NOLM4RYYTHRHAQHG3YF337652CQFP5I5TQFR4OG7NUQYHTBEEEHA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.289307070 (127h56m58.269659713s) [noise=true , address=145.79.227.40:4066 , piece_id=O7RQ6C62GTFATP4CRBKUIFRVQ6O57DXDMQ4RAMBUSC5SB3KZUUPQ, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.291609955 (127h56m58.271962594s) [noise=true , address=145.79.227.11:4733 , piece_id=MPTGGCZ3APLVDZ55PDLUOV557NLCCW5THSV7U7WHNHVVHA75WSYA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.292890304 (127h56m58.273242945s) [noise=true , address=145.79.227.33:4872 , piece_id=NC6D3ASYLAHMMMURRTOCN4IA3Y2QNXV44C6AEJ65FVMLZNQ2E5KA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.293864436 (127h56m58.274217075s) [noise=true , address=145.79.227.28:4746 , piece_id=BBITBBMJVXHPGA525Z2FVBNH3JWQJPYG6VJVY6HSKTXETZ7EHYFQ, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.297582116 (127h56m58.277934759s) [noise=true , address=45.91.116.9:4278 , piece_id=LTT5IVZUCVIWT3S2EWZD2PYZVU4YLPP3RNR2QQIBWWKKCFEUZZZA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:18.302110464 (127h56m58.28246311s) [noise=true , address=45.91.116.4:4960 , piece_id=UJV6XS6TELRHP6QQPUBO33MVSYEGQX67WOYFVQGXXFVTIQ4GDXOQ, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:25:19.532618793 (127h56m59.51297143s) [noise=true , address=145.79.227.16:4938 , piece_id=P6JROZHXTG6LUHFSPBO4UTNSBG67OE56B3XMRSCYRCI25Y5FFJXQ, seg_pos={0 0}, upload=112470]: Done uploading piece. err: <nil> Dec 10 23:26:17.156292754 (127h57m57.136645514s) [noise=true , address=77.90.31.15:4709 , piece_id=FKU6TV3E7MLXK77RPIOFAIWKRVQ2F2ITRTDGXX5VA4IF55NQBLXA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:44770->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.156492904 (127h57m57.136845543s) [noise=true , address=77.90.31.10:4523 , piece_id=USTCUT5TMG63OSDNDFXP7QWKZGAHGBEXZWUOFQLQMSY6WFPRP2FA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa, address:77.90.31.10:4523): protocol: write tcp 139.59.144.22:54248->77.90.31.10:4523: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.156624865 (127h57m57.136977504s) [noise=true , address=77.90.31.10:4547 , piece_id=XLQ2IFDILHAGMKLI2BXVJKMUHLA24HK7UROLJ3HWNRYMTWOV5QQA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ, address:77.90.31.10:4547): protocol: write tcp 139.59.144.22:40690->77.90.31.10:4547: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.156670056 (127h57m57.137022705s) [noise=true , address=77.90.31.19:4848 , piece_id=FNOBYSAPIPNRUDOXPAQTVTG4RV6OE2ZJOPQ3V43FXLYQLZ3XJCQQ, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 139.59.144.22:46944->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.157015200 (127h57m57.137367847s) [noise=true , address=77.90.31.13:4654 , piece_id=MTEXSMCPQQUE6EVV4VIM3MZBEXMNNBWARS2BYYR6OSXQ6QSUOVFA, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8, address:77.90.31.13:4654): protocol: write tcp 139.59.144.22:43442->77.90.31.13:4654: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.157028049 (127h57m57.137380688s) [noise=true , address=77.90.31.16:4762 , piece_id=3Z44UXNPWIU3HODWONE5GLHSWVRNWS3ZGH4PQMFWWLS4ZIZ7FH3Q, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR, address:77.90.31.16:4762): protocol: write tcp 139.59.144.22:58020->77.90.31.16:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.157118492 (127h57m57.137471131s) [noise=true , address=77.90.31.12:4594 , piece_id=B6YB7COA2IBHMHEHSNOHOJ4JW3NXTKGJ3AFI752HNPND47HKWH5Q, seg_pos={0 0}, upload=112470]: Done uploading piece. err: ecclient: upload failed (node:1J9Cvfqr5QUrVSoqXVMoVtaXUbvcoXWMFoJXoZyuQreSgQbTtU, address:77.90.31.12:4594): protocol: write tcp 139.59.144.22:34946->77.90.31.12:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:26:17.157203782 (127h57m57.137556405s) [seg_pos={0 0}, upload=112470]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Dec 10 23:26:17.268176637 (127h57m57.248529274s) [upload=112470]: Done uploading segments... Dec 10 23:26:17.268210723 (127h57m57.248563362s) [upload=112470]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.113618887s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................................XXX.] duration: 2.906176935s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:25:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.90620653s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.001329538s trace: https://jaeger.dev.storj.io/trace/1d94eac5699bd6c5 FAIL (2025-12-10 23:25:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001346023s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.125901476s trace: https://jaeger.dev.storj.io/trace/56b6dd248b61cf59 FAIL (2025-12-10 23:25:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 316257295 (127h55m57.29660994s) [noise=true , address=45.91.116.11:4147 , piece_id=KMWEZIACAOJ2E7BD26KOWQF43LBUX6FQPNE6X7XJNG75YLIMSECQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.316404800 (127h55m57.296757447s) [noise=true , address=145.79.227.35:4515 , piece_id=GQPMUZZW4YFE6N6GX56I567BL4TBLRCWYICJ5LRPYQO4M63KI7LA, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.316957265 (127h55m57.297309918s) [noise=true , address=64.49.13.154:4931 , piece_id=4SC2XODAY56EKFJ4OOAO253PLMBRS4TYOOPSNRBKDEZIWWHWCOEQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.317399372 (127h55m57.297752021s) [noise=true , address=77.90.31.16:4768 , piece_id=J6PDZQZY4MHU23JXIA6VFU2X2ZW5OSLIP4YDJMIFPHMKVXLCG5BQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.317897122 (127h55m57.298249772s) [noise=true , address=77.90.31.17:4792 , piece_id=VBATAITAXOSLFSTQYBF2HE5OXMVGAUMMVR76MO4TPXP4YZW7LHAA, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.318376770 (127h55m57.29872942s) [noise=true , address=45.91.116.14:4202 , piece_id=FUYRUZIK5EECWSTGJEO27TFQ4GN35R6XZNTREXQLNIV4TI3JKMSQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.318560917 (127h55m57.298913571s) [noise=true , address=45.91.116.4:4970 , piece_id=SLSAEISHKWAOTAFLCAV363Q6TT75GU6QIUZZTLBTCCIMQVYZP3UA, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.318774182 (127h55m57.299126832s) [noise=true , address=77.90.31.10:4528 , piece_id=TLZY7TLHEODOZUWTVVGCG2BNCWQK6JT25N2XGTI3CHHO6WDCW6EQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.319206898 (127h55m57.299559548s) [noise=true , address=45.91.116.13:4166 , piece_id=O75UTSVIHHZHFCMDN5RWJWMBJMOH3DNTGDXQPX4XAAPCLNGSAHGQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.319254902 (127h55m57.299607557s) [noise=true , address=145.79.227.12:4793 , piece_id=EAWZNDREGC7FA3DQ3WGPNKWNW7JKN6JVR2BJOM6RFGFCFHFVOUNQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.319640417 (127h55m57.299993067s) [noise=true , address=45.91.116.9:4290 , piece_id=EGVU7DZN5XS3CLDLQTTK6FXEVSZ7DKXXQZZENKR4RWD3QBQR5INQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.319822298 (127h55m57.300174939s) [noise=true , address=77.90.31.13:4635 , piece_id=XMS6F27WMQHUUECMSNZJOMMG753UAB65DEKNR2V6UGDV3IYXL6FA, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.320067642 (127h55m57.300420286s) [noise=true , address=77.90.31.15:4727 , piece_id=A7NRQLF4YDLVQFYTSM467Z73DLGT24NZFRPG25VLLODFKLMRUYNQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.320510038 (127h55m57.300862688s) [noise=true , address=145.79.227.25:4628 , piece_id=NHHOLTCBI3ZI6E7AQ7DTYZDXWJ4UPEAZMYF4YGXNUHKIFL7KKBGQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.320555386 (127h55m57.300908036s) [noise=true , address=77.90.31.18:4811 , piece_id=7GIFYWQKJONQG6H372TQZEPENDZXIL3GI5PVPE7IXFMARY32OCGQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.321742703 (127h55m57.302095353s) [noise=true , address=64.49.13.169:4715 , piece_id=KLXEMNHHUDSXL4G4CFOWM7WWQMX6M4PNPGJOUMQTQXKR5ILDVAZQ, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.322393536 (127h55m57.302746187s) [noise=true , address=145.79.227.28:4746 , piece_id=ETEAKLJ7NZV765A74MKYLOV34QATFOSMNMFD6KGMY54PDT3DE6DA, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.325742807 (127h55m57.306095457s) [noise=true , address=77.90.31.11:4557 , piece_id=66M7VHYSHBGKQ2HKCO2TPHHMDU5HP3WLTQ46MPWQBMTZBTHVTG5Q, seg_pos={0 0}, upload=112454]: Uploading piece... Dec 10 23:24:17.855194300 (127h55m57.835546948s) [upload=112454]: Next returned nil segment Dec 10 23:24:17.855211428 (127h55m57.835564077s) [upload=112454]: Waiting for error group managing segments... Dec 10 23:24:18.037826823 (127h55m58.018179461s) [noise=true , address=45.91.116.11:4147 , piece_id=KMWEZIACAOJ2E7BD26KOWQF43LBUX6FQPNE6X7XJNG75YLIMSECQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.044763061 (127h55m58.025115707s) [noise=true , address=45.91.116.4:4970 , piece_id=SLSAEISHKWAOTAFLCAV363Q6TT75GU6QIUZZTLBTCCIMQVYZP3UA, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.059473698 (127h55m58.039826345s) [noise=true , address=145.79.227.25:4628 , piece_id=NHHOLTCBI3ZI6E7AQ7DTYZDXWJ4UPEAZMYF4YGXNUHKIFL7KKBGQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.059575302 (127h55m58.039927945s) [noise=true , address=45.91.116.9:4290 , piece_id=EGVU7DZN5XS3CLDLQTTK6FXEVSZ7DKXXQZZENKR4RWD3QBQR5INQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.059995859 (127h55m58.040348497s) [noise=true , address=145.79.227.28:4746 , piece_id=ETEAKLJ7NZV765A74MKYLOV34QATFOSMNMFD6KGMY54PDT3DE6DA, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.061726511 (127h55m58.042079151s) [noise=true , address=45.91.116.13:4166 , piece_id=O75UTSVIHHZHFCMDN5RWJWMBJMOH3DNTGDXQPX4XAAPCLNGSAHGQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.070032034 (127h55m58.050384672s) [noise=true , address=145.79.227.35:4515 , piece_id=GQPMUZZW4YFE6N6GX56I567BL4TBLRCWYICJ5LRPYQO4M63KI7LA, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.070182101 (127h55m58.050534739s) [noise=true , address=45.91.116.14:4202 , piece_id=FUYRUZIK5EECWSTGJEO27TFQ4GN35R6XZNTREXQLNIV4TI3JKMSQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.081020909 (127h55m58.061373552s) [noise=true , address=145.79.227.12:4793 , piece_id=EAWZNDREGC7FA3DQ3WGPNKWNW7JKN6JVR2BJOM6RFGFCFHFVOUNQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:18.792999161 (127h55m58.773351797s) [noise=true , address=64.49.13.154:4931 , piece_id=4SC2XODAY56EKFJ4OOAO253PLMBRS4TYOOPSNRBKDEZIWWHWCOEQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:24:28.956787494 (127h56m8.937140137s) [noise=true , address=64.49.13.169:4715 , piece_id=KLXEMNHHUDSXL4G4CFOWM7WWQMX6M4PNPGJOUMQTQXKR5ILDVAZQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: <nil> Dec 10 23:25:16.896313023 (127h56m56.876665668s) [noise=true , address=77.90.31.16:4768 , piece_id=J6PDZQZY4MHU23JXIA6VFU2X2ZW5OSLIP4YDJMIFPHMKVXLCG5BQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:12UchewmtxBrtSZSpVAJFdZmcTsQVQxkjK9re6cgUGqDhyonQeF, address:77.90.31.16:4768): protocol: write tcp 139.59.144.22:46362->77.90.31.16:4768: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.896709965 (127h56m56.877062603s) [noise=true , address=77.90.31.18:4811 , piece_id=7GIFYWQKJONQG6H372TQZEPENDZXIL3GI5PVPE7IXFMARY32OCGQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:1AZxy9wnMgVu2PdFNtFrShYhWfF6PL4mgWumjqVk68voKsnMk6, address:77.90.31.18:4811): protocol: write tcp 139.59.144.22:58816->77.90.31.18:4811: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.899993349 (127h56m56.880345992s) [noise=true , address=77.90.31.10:4528 , piece_id=TLZY7TLHEODOZUWTVVGCG2BNCWQK6JT25N2XGTI3CHHO6WDCW6EQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:15fkvAWei1E5Tn2BYkCavyZ8se6XwPJcmpr7aEsv8sbMtk1n3Q, address:77.90.31.10:4528): protocol: write tcp 139.59.144.22:47964->77.90.31.10:4528: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.900113801 (127h56m56.880466452s) [noise=true , address=77.90.31.15:4727 , piece_id=A7NRQLF4YDLVQFYTSM467Z73DLGT24NZFRPG25VLLODFKLMRUYNQ, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: write tcp 139.59.144.22:41782->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.900878958 (127h56m56.881231605s) [noise=true , address=77.90.31.11:4557 , piece_id=66M7VHYSHBGKQ2HKCO2TPHHMDU5HP3WLTQ46MPWQBMTZBTHVTG5Q, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: context deadline exceeded; context deadline exceeded Dec 10 23:25:16.901500190 (127h56m56.881852846s) [noise=true , address=77.90.31.17:4792 , piece_id=VBATAITAXOSLFSTQYBF2HE5OXMVGAUMMVR76MO4TPXP4YZW7LHAA, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN, address:77.90.31.17:4792): protocol: write tcp 139.59.144.22:44580->77.90.31.17:4792: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.902997884 (127h56m56.883350526s) [noise=true , address=77.90.31.13:4635 , piece_id=XMS6F27WMQHUUECMSNZJOMMG753UAB65DEKNR2V6UGDV3IYXL6FA, seg_pos={0 0}, upload=112454]: Done uploading piece. err: ecclient: upload failed (node:1hkgeCi3efNQFv37chVFEi4v2AyWFEwv9keyy5oz6RkJ4Ubunp, address:77.90.31.13:4635): protocol: write tcp 139.59.144.22:41328->77.90.31.13:4635: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:25:16.903041430 (127h56m56.883394066s) [seg_pos={0 0}, upload=112454]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Dec 10 23:25:17.018703490 (127h56m56.99905614s) [upload=112454]: Done uploading segments... Dec 10 23:25:17.018749306 (127h56m56.999101958s) [upload=112454]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 1m0.125917157s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........................................................XXX] duration: 5.001528825s trace: https://jaeger.dev.storj.io/trace/4d18ebf192707efc FAIL (2025-12-10 23:25:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001557982s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.000735949s trace: https://jaeger.dev.storj.io/trace/f62dc2852183e2d FAIL (2025-12-10 23:24:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000760577s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................................XX] duration: 5.000726416s trace: https://jaeger.dev.storj.io/trace/58a8d9df88631af5 FAIL (2025-12-10 23:24:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000751711s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.119198866s trace: https://jaeger.dev.storj.io/trace/29207151ace2caff FAIL (2025-12-10 23:24:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== egmentBegin Dec 10 23:23:17.048239916 (127h54m57.028592552s) [seg_pos={0 0}, upload=112440]: Begin upload segment... Dec 10 23:23:17.048292991 (127h54m57.028645622s) [seg_pos={0 0}, upload=112440]: Done begin upload segment. Dec 10 23:23:17.048332640 (127h54m57.028685276s) [noise=true , address=45.91.116.8:4058 , piece_id=5C2X2N3UD2TKELQKODS6I7MWAMPC7KW5AGGQRIPKUVOTSRAPZCCA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.049411981 (127h54m57.029764647s) [noise=true , address=77.90.31.13:4651 , piece_id=FSHQVJNZDIJADQB737ZEKFMOTACI76TMEZQQYI2YGI4H57BWCODA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.049861788 (127h54m57.030214427s) [noise=true , address=77.90.31.14:4681 , piece_id=EZZVNSXZHRU7UVGN32B7T3H5HD4432TOPABDUTQIJEJ5YIYGLSSQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.050217058 (127h54m57.030569698s) [noise=true , address=45.91.116.10:4090 , piece_id=EPMC7VHRWDVXEHIDE3PZ5NXHTBH6DSLWTLY4CE5EOF5JHTLHB2KQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.050639950 (127h54m57.030992589s) [noise=true , address=145.79.227.44:4216 , piece_id=DZOKQGVNEG6377DGRM44ZRPMCTD4LIRF7NX2NO6W7VQYAZHGPHVA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.051034985 (127h54m57.031387622s) [noise=true , address=77.90.31.18:4821 , piece_id=EHDGQWKWPMXF2XOK7HQ6URRSEKJL7XG53DKAAC6LQ55J362UTXEA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.051602516 (127h54m57.031955158s) [noise=true , address=145.79.227.41:4094 , piece_id=IB2KGJB43MEYMJB2T7JLXGOZVONUKEJE32Q5ZHA6TZTEEIZRSDVA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.052016389 (127h54m57.032369029s) [noise=true , address=45.91.116.12:4242 , piece_id=HWN7WNKCLEPGVPNEURIV4JJF7W53OKL2WK4K46DFZMVHV3NHPJGQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.052490887 (127h54m57.032843524s) [noise=true , address=45.91.116.6:4002 , piece_id=FEUTYZDLCICAMGRDQC7I5NAJVNNR7NNMIPXCJQVE2NTDL2YAR5LA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.052879752 (127h54m57.033232378s) [noise=true , address=145.79.227.22:4541 , piece_id=KPZ2U6GS7NLWC47N4QJOKUMC5YHGIGLL7QTPAADU34W6NTQQRDPA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.053328112 (127h54m57.033680759s) [noise=true , address=77.90.31.15:4720 , piece_id=WYDK5Q26KGURSQ7SXXUXRKB44FWN73EEJCRTTX2ABEJZ7WM657VQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.053833222 (127h54m57.034185849s) [noise=true , address=64.49.13.169:4710 , piece_id=ZOSQOQ3ANEEPFP4K3HINWTMP2RNB6JNRT2AU3UTRMTUKBT4EC2IA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.054648809 (127h54m57.035001454s) [noise=true , address=5.231.73.5:4030 , piece_id=L454MD7GIJIZUG3WSYRQXGQTBKS4INB64SKSVP7AO43LMEIRO7LA, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.055256769 (127h54m57.035609415s) [noise=true , address=77.90.31.13:4641 , piece_id=G7WLDI44PL5ZPGSVSH6DMNYUGAHXESY6BW4AUHEXTF2RNI3S455A, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.055756826 (127h54m57.036109465s) [noise=true , address=145.79.227.10:4417 , piece_id=2O5XDBMLAJU3NCPSSGKXXIXM7FTVPNOEABDDL3CUY4AJB7263HHQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.056190139 (127h54m57.036542778s) [noise=true , address=77.90.31.10:4523 , piece_id=GGVOE27F2QLSZOHFAEIG7DOMY3VSS4C7VLYHKC5RMMA626XEHRGQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.056592195 (127h54m57.036944822s) [noise=true , address=145.79.227.28:4746 , piece_id=Q36QAQRPUKXUXF4QYU7OZIHMJ6QLJGT7MTN4IIDYSKYMU44GE3WQ, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.057029787 (127h54m57.037382427s) [noise=true , address=145.79.227.47:4300 , piece_id=JUHRJTJODWF4W75XDLO4E2NUIIWAX35W5FPWAOPFGML4PM27JD5Q, seg_pos={0 0}, upload=112440]: Uploading piece... Dec 10 23:23:17.606072218 (127h54m57.586424847s) [upload=112440]: Next returned nil segment Dec 10 23:23:17.606097341 (127h54m57.58644998s) [upload=112440]: Waiting for error group managing segments... Dec 10 23:23:17.750786984 (127h54m57.731139631s) [noise=true , address=45.91.116.12:4242 , piece_id=HWN7WNKCLEPGVPNEURIV4JJF7W53OKL2WK4K46DFZMVHV3NHPJGQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.751576071 (127h54m57.731928716s) [noise=true , address=145.79.227.22:4541 , piece_id=KPZ2U6GS7NLWC47N4QJOKUMC5YHGIGLL7QTPAADU34W6NTQQRDPA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.752293076 (127h54m57.732645723s) [noise=true , address=145.79.227.28:4746 , piece_id=Q36QAQRPUKXUXF4QYU7OZIHMJ6QLJGT7MTN4IIDYSKYMU44GE3WQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.757695284 (127h54m57.738047924s) [noise=true , address=145.79.227.41:4094 , piece_id=IB2KGJB43MEYMJB2T7JLXGOZVONUKEJE32Q5ZHA6TZTEEIZRSDVA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.759205122 (127h54m57.739557763s) [noise=true , address=145.79.227.47:4300 , piece_id=JUHRJTJODWF4W75XDLO4E2NUIIWAX35W5FPWAOPFGML4PM27JD5Q, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.762873240 (127h54m57.743225886s) [noise=true , address=45.91.116.8:4058 , piece_id=5C2X2N3UD2TKELQKODS6I7MWAMPC7KW5AGGQRIPKUVOTSRAPZCCA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.763691910 (127h54m57.744044588s) [noise=true , address=45.91.116.6:4002 , piece_id=FEUTYZDLCICAMGRDQC7I5NAJVNNR7NNMIPXCJQVE2NTDL2YAR5LA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.764008416 (127h54m57.744361055s) [noise=true , address=145.79.227.10:4417 , piece_id=2O5XDBMLAJU3NCPSSGKXXIXM7FTVPNOEABDDL3CUY4AJB7263HHQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.775432967 (127h54m57.755785612s) [noise=true , address=45.91.116.10:4090 , piece_id=EPMC7VHRWDVXEHIDE3PZ5NXHTBH6DSLWTLY4CE5EOF5JHTLHB2KQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:17.905697985 (127h54m57.886050611s) [noise=true , address=5.231.73.5:4030 , piece_id=L454MD7GIJIZUG3WSYRQXGQTBKS4INB64SKSVP7AO43LMEIRO7LA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:18.700464507 (127h54m58.680817144s) [noise=true , address=145.79.227.44:4216 , piece_id=DZOKQGVNEG6377DGRM44ZRPMCTD4LIRF7NX2NO6W7VQYAZHGPHVA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:23:29.675180041 (127h55m9.65553268s) [noise=true , address=64.49.13.169:4710 , piece_id=ZOSQOQ3ANEEPFP4K3HINWTMP2RNB6JNRT2AU3UTRMTUKBT4EC2IA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: <nil> Dec 10 23:24:16.636188892 (127h55m56.616541535s) [noise=true , address=77.90.31.15:4720 , piece_id=WYDK5Q26KGURSQ7SXXUXRKB44FWN73EEJCRTTX2ABEJZ7WM657VQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:12VbsxFqMB3vVphSAJqYpbBzua7Goq45E6ovJSaExkpLtfkcc74, address:77.90.31.15:4720): protocol: write tcp 139.59.144.22:43264->77.90.31.15:4720: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.636693441 (127h55m56.617046089s) [noise=true , address=77.90.31.14:4681 , piece_id=EZZVNSXZHRU7UVGN32B7T3H5HD4432TOPABDUTQIJEJ5YIYGLSSQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:1R83hjsxTbEvxkf1HCTYfbFQrQFsqWEq8rjr2SEYFprjB9QTEa, address:77.90.31.14:4681): protocol: write tcp 139.59.144.22:43600->77.90.31.14:4681: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.636933787 (127h55m56.617286437s) [noise=true , address=77.90.31.18:4821 , piece_id=EHDGQWKWPMXF2XOK7HQ6URRSEKJL7XG53DKAAC6LQ55J362UTXEA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:12dSS7NcpaDB98oZdBM6vFe56mejA8fJZKA5YvERXTD9qqXVPdH, address:77.90.31.18:4821): protocol: write tcp 139.59.144.22:48448->77.90.31.18:4821: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.639073917 (127h55m56.619426565s) [noise=true , address=77.90.31.10:4523 , piece_id=GGVOE27F2QLSZOHFAEIG7DOMY3VSS4C7VLYHKC5RMMA626XEHRGQ, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:1LifXs8irH3dbLrzPnXzoCfaFyuUJxsN4rfyLEwTKGXSPxotPa, address:77.90.31.10:4523): protocol: rpc: dial tcp 77.90.31.10:4523: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.639333678 (127h55m56.619686329s) [noise=true , address=77.90.31.13:4641 , piece_id=G7WLDI44PL5ZPGSVSH6DMNYUGAHXESY6BW4AUHEXTF2RNI3S455A, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: rpc: dial tcp 77.90.31.13:4641: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.639722400 (127h55m56.620075048s) [noise=true , address=77.90.31.13:4651 , piece_id=FSHQVJNZDIJADQB737ZEKFMOTACI76TMEZQQYI2YGI4H57BWCODA, seg_pos={0 0}, upload=112440]: Done uploading piece. err: ecclient: upload failed (node:12KZPTKQVuPNRTddMCCVpEgu9z5aC3ooJC854HpuA9223XEQA1o, address:77.90.31.13:4651): protocol: write tcp 139.59.144.22:38836->77.90.31.13:4651: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:24:16.639761678 (127h55m56.620114334s) [seg_pos={0 0}, upload=112440]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Dec 10 23:24:16.752847265 (127h55m56.733199912s) [upload=112440]: Done uploading segments... Dec 10 23:24:16.752891964 (127h55m56.733244608s) [upload=112440]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 1m0.119212325s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000982955s trace: https://jaeger.dev.storj.io/trace/66dc161bf5f21ff7 FAIL (2025-12-10 23:23:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001006283s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.109022161s trace: https://jaeger.dev.storj.io/trace/4893324be1ec9a68 FAIL (2025-12-10 23:23:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== CB2I7C5CVK6RFH72B5BQGQOKYJ47NBFGA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.799712258 (127h53m56.780064908s) [noise=true , address=77.90.31.16:4746 , piece_id=FAYI6NSMEZC4GJAEOMENG5R4M5SQR4DYPEYEA5YUIA3PAXGVMTSQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.800042105 (127h53m56.780394754s) [noise=true , address=145.79.227.39:4045 , piece_id=VDGAHXMK3CKTADSDQPEDNIKNXLHFBH3NMIODFEHNFPHXFKBOWFZA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.800492238 (127h53m56.780844886s) [noise=true , address=5.231.73.5:4024 , piece_id=XFJG3UB4FCTCF3IJIKZQE2BK5TTYHYGEWDC5Q6YOLS4XW6TH2XPQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.800507745 (127h53m56.780860394s) [noise=true , address=145.79.227.46:4636 , piece_id=NOLYFBXI35OPLPJZEDIYJYG55NHRAU4CUZ7ZIXRWAOUHHSM65POA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.800997668 (127h53m56.781350317s) [noise=true , address=77.90.31.15:4725 , piece_id=6JEW5T2OYNTD2YHSIQQKR5Z7MQOW64GOFNWHZP5XZPGH266OXJLA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.801297015 (127h53m56.781649665s) [noise=true , address=145.79.227.34:4911 , piece_id=M3XCXSDAWDVFRVH64SSNN7SGTXI7K2DUU7Y7QGEUZ2JEIBGMYDUQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.801513697 (127h53m56.781866346s) [noise=true , address=5.231.73.2:4010 , piece_id=IJZEYGXCVXJ3Z4WEQVVTPAY3HLN2DDC2FH5KU3TNXHCXO3RC4PAA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.802005748 (127h53m56.782358399s) [noise=true , address=145.79.227.52:4477 , piece_id=RTZFHWJLHSXUEMTJ66PRKMCGRRNBOJFFTLFEDXLLCS7UQTSFYTJA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.802036987 (127h53m56.782389666s) [noise=true , address=77.90.31.18:4813 , piece_id=MNBWJWNBK2C7BY4KTOXK4JOVY2Y7POSJJURRZYIKK4MRGBKL3VGQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.802518055 (127h53m56.7828707s) [noise=true , address=77.90.31.17:4793 , piece_id=OENHB7FLJF3OCHDBUROT5TMBQQ5TXP7UWQDDSM354E2OX42NGCGQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.802745435 (127h53m56.783098089s) [noise=true , address=77.90.31.13:4635 , piece_id=3MCRAWULKQCGLKTMC24SO27R4T33OL63OMZCPHWJ5BI7QB7WXJVA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.806274974 (127h53m56.786627623s) [noise=true , address=145.79.227.5:4228 , piece_id=4JGEV7WC64N5D4YCGIC43LCOH3NONIVNBACHRTS7KYW4SYJC6BVA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.807265156 (127h53m56.787617804s) [noise=true , address=77.90.31.11:4581 , piece_id=2WVYVW2K34EO3S237JK2LKOYHFTRBL7RPRME3MTSES5Z5P747W4A, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.809489537 (127h53m56.789842186s) [noise=true , address=145.79.227.41:4112 , piece_id=KQVYJYFMEJRVV36QF7QJ5OE2OPAGCTUD4GQ6TPFPWZQHNEUULE6A, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.810164424 (127h53m56.790517072s) [noise=true , address=5.231.73.4:4021 , piece_id=OFP5EQORG5SPJI655DNF3ZX243VYJONOZG2WGFWJI5FYRNKHUNKA, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:16.811398065 (127h53m56.791750714s) [noise=true , address=77.90.31.10:4552 , piece_id=GBNVGII2YB3GN3H65K7O53CV5GOO7XFS6DJKX6OI57VWO5WXRVDQ, seg_pos={0 0}, upload=112429]: Uploading piece... Dec 10 23:22:17.367538112 (127h53m57.34789075s) [upload=112429]: Next returned nil segment Dec 10 23:22:17.367556394 (127h53m57.347909041s) [upload=112429]: Waiting for error group managing segments... Dec 10 23:22:17.503412040 (127h53m57.483764677s) [noise=true , address=145.79.227.52:4477 , piece_id=RTZFHWJLHSXUEMTJ66PRKMCGRRNBOJFFTLFEDXLLCS7UQTSFYTJA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.510992698 (127h53m57.491345338s) [noise=true , address=145.79.227.46:4636 , piece_id=NOLYFBXI35OPLPJZEDIYJYG55NHRAU4CUZ7ZIXRWAOUHHSM65POA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.514618798 (127h53m57.494971437s) [noise=true , address=145.79.227.5:4228 , piece_id=4JGEV7WC64N5D4YCGIC43LCOH3NONIVNBACHRTS7KYW4SYJC6BVA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.514943912 (127h53m57.495296549s) [noise=true , address=145.79.227.39:4045 , piece_id=VDGAHXMK3CKTADSDQPEDNIKNXLHFBH3NMIODFEHNFPHXFKBOWFZA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.517623026 (127h53m57.497975664s) [noise=true , address=145.79.227.41:4112 , piece_id=KQVYJYFMEJRVV36QF7QJ5OE2OPAGCTUD4GQ6TPFPWZQHNEUULE6A, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.523878665 (127h53m57.504231304s) [noise=true , address=145.79.227.34:4911 , piece_id=M3XCXSDAWDVFRVH64SSNN7SGTXI7K2DUU7Y7QGEUZ2JEIBGMYDUQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.566770913 (127h53m57.547123552s) [noise=true , address=45.91.116.5:4306 , piece_id=LMOAR6QOWAYK2UUB5JFCB2I7C5CVK6RFH72B5BQGQOKYJ47NBFGA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.700706132 (127h53m57.681058772s) [noise=true , address=5.231.73.2:4010 , piece_id=IJZEYGXCVXJ3Z4WEQVVTPAY3HLN2DDC2FH5KU3TNXHCXO3RC4PAA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.701718459 (127h53m57.682071099s) [noise=true , address=5.231.73.5:4024 , piece_id=XFJG3UB4FCTCF3IJIKZQE2BK5TTYHYGEWDC5Q6YOLS4XW6TH2XPQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:22:17.704323265 (127h53m57.684675902s) [noise=true , address=5.231.73.4:4021 , piece_id=OFP5EQORG5SPJI655DNF3ZX243VYJONOZG2WGFWJI5FYRNKHUNKA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: <nil> Dec 10 23:23:16.392943816 (127h54m56.373296454s) [noise=true , address=77.90.31.10:4552 , piece_id=GBNVGII2YB3GN3H65K7O53CV5GOO7XFS6DJKX6OI57VWO5WXRVDQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1sZq8qBrujZ1JMFYMhfCLsjnm7V3FE2KVxPuqFeWC2VMW1yzfp, address:77.90.31.10:4552): protocol: write tcp 139.59.144.22:43066->77.90.31.10:4552: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393017580 (127h54m56.373370222s) [noise=true , address=77.90.31.13:4635 , piece_id=3MCRAWULKQCGLKTMC24SO27R4T33OL63OMZCPHWJ5BI7QB7WXJVA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1hkgeCi3efNQFv37chVFEi4v2AyWFEwv9keyy5oz6RkJ4Ubunp, address:77.90.31.13:4635): protocol: write tcp 139.59.144.22:54272->77.90.31.13:4635: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393247101 (127h54m56.373599741s) [noise=true , address=77.90.31.12:4613 , piece_id=ADFHQPQSSTCOEPR7ZAHLOWA4YJG77XKFRF3E66BA3GX4622SY6EA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:51494->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393400216 (127h54m56.373752854s) [noise=true , address=77.90.31.17:4793 , piece_id=OENHB7FLJF3OCHDBUROT5TMBQQ5TXP7UWQDDSM354E2OX42NGCGQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: write tcp 139.59.144.22:39564->77.90.31.17:4793: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393434350 (127h54m56.373786995s) [noise=true , address=77.90.31.16:4746 , piece_id=FAYI6NSMEZC4GJAEOMENG5R4M5SQR4DYPEYEA5YUIA3PAXGVMTSQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o, address:77.90.31.16:4746): protocol: rpc: dial tcp 77.90.31.16:4746: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393516816 (127h54m56.373869455s) [noise=true , address=77.90.31.11:4581 , piece_id=2WVYVW2K34EO3S237JK2LKOYHFTRBL7RPRME3MTSES5Z5P747W4A, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1MP1x3VuzX7cQPmD9pY3Cw1v6W2Q5LqUDdKesqX31vL9JLTRAp, address:77.90.31.11:4581): protocol: write tcp 139.59.144.22:35938->77.90.31.11:4581: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393592873 (127h54m56.373945515s) [noise=true , address=77.90.31.15:4725 , piece_id=6JEW5T2OYNTD2YHSIQQKR5Z7MQOW64GOFNWHZP5XZPGH266OXJLA, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk, address:77.90.31.15:4725): protocol: write tcp 139.59.144.22:34284->77.90.31.15:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393624725 (127h54m56.373977363s) [noise=true , address=77.90.31.18:4813 , piece_id=MNBWJWNBK2C7BY4KTOXK4JOVY2Y7POSJJURRZYIKK4MRGBKL3VGQ, seg_pos={0 0}, upload=112429]: Done uploading piece. err: ecclient: upload failed (node:128WthA1x9wp1dV1vkpGnoveZQpU9CSgDCZfw5GMQuVpCNSVAM5, address:77.90.31.18:4813): protocol: write tcp 139.59.144.22:45478->77.90.31.18:4813: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 10 23:23:16.393647490 (127h54m56.374000113s) [seg_pos={0 0}, upload=112429]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Dec 10 23:23:16.499481873 (127h54m56.47983451s) [upload=112429]: Done uploading segments... Dec 10 23:23:16.499523053 (127h54m56.479875699s) [upload=112429]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.109048921s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.001527218s trace: https://jaeger.dev.storj.io/trace/6b3ce71cca372ca FAIL (2025-12-10 23:23:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001551081s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.143183216s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:22:43 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.143209633s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.681834601s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:22:21 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.681861754s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.103914561s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:21:23 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.103951791s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.972877682s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:21:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.972905624s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.154235975s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:20:56 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.154264681s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.636035452s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:20:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.636069019s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.369312088s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:20:08 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.369341582s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 3.062252384s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:20:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.062279444s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.229286414s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:19:40 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.229385455s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.907232739s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:19:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.907333411s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.824304827s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:18:47 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.824322677s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.649517736s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:18:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.649546602s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.731067305s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:18:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.73116611s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.185973438s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:17:46 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.186010122s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.770064244s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:17:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.77009714s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.347912358s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:17:23 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.347942801s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.262709617s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:16:39 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.262742475s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.508919534s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:16:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.508961281s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.159870494s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:16:04 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.159909381s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.994809842s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:16:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.994837107s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.787110314s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:15:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.787140876s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.191045801s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:15:08 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.191075125s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.860804799s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:14:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.860828979s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.346935953s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:14:12 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.346964528s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.805586563s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:14:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.805612937s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.281043545s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:13:50 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.281072763s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.332370325s trace: https://jaeger.dev.storj.io/trace/7967e83cf076f7a1 FAIL (2025-12-10 21:13:23 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.332402562s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.50836097s trace: https://jaeger.dev.storj.io/trace/24b2626d6efa5051 FAIL (2025-12-10 21:13:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.508387183s edge gateway us-select-1

1
...
109
110
111
112
113
...
3722