Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.400562122s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:44:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.400589659s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.453649699s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:44:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.453677089s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.551487768s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:44:14 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.551515621s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.48893135s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:43:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.48895724s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.422399069s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:43:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.422438297s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.522854622s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:42:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.52288223s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.444343666s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:42:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.444374515s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.544858611s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:42:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.544896102s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.639143392s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:42:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.639169956s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.542982061s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:41:45 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.543015318s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.455810474s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:41:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 2.455828685s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002984509s trace: https://jaeger.dev.storj.io/trace/6dd0c410ba33bf68 FAIL (2025-12-26 01:41:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 26 01:40:56.786434801 (490h12m36.76678744s) [upload=431275]: Starting upload Dec 26 01:40:56.786538380 (490h12m36.766891016s) [upload=431275]: Done starting upload Dec 26 01:40:56.786864489 (490h12m36.767217127s) [upload=431275]: Uploading segments... Dec 26 01:40:56.786910626 (490h12m36.767263269s) [upload=431275]: Got next segment. Inline: false Dec 26 01:40:56.786959120 (490h12m36.767311766s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 26 01:40:56.786964773 (490h12m36.767317413s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 26 01:40:56.894684410 (490h12m36.87503706s) [seg_pos={0 0}, upload=431275]: Begin upload segment... Dec 26 01:40:56.894748172 (490h12m36.875100808s) [seg_pos={0 0}, upload=431275]: Done begin upload segment. Dec 26 01:40:56.894813683 (490h12m36.875166321s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.895509561 (490h12m36.875862197s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896066084 (490h12m36.876418726s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.896657621 (490h12m36.877010264s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897031767 (490h12m36.877384404s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897280953 (490h12m36.877633589s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897746829 (490h12m36.878099475s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.897840640 (490h12m36.878193279s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898237672 (490h12m36.878590317s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898309178 (490h12m36.878661823s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898625804 (490h12m36.878978441s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898743568 (490h12m36.879096207s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.898910902 (490h12m36.879263537s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899224823 (490h12m36.87957746s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.899685237 (490h12m36.880037874s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:56.900270386 (490h12m36.88062304s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Uploading piece... Dec 26 01:40:57.497404274 (490h12m37.477756911s) [upload=431275]: Next returned nil segment Dec 26 01:40:57.497421740 (490h12m37.477774384s) [upload=431275]: Waiting for error group managing segments... Dec 26 01:40:57.641457733 (490h12m37.621810369s) [noise=true , address=45.91.116.13:4155 , piece_id=JW7HPMHTMAVGJNJZ3LAUCCTM3Y35BYMCOOQILBGGGJRMREIFWE6A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.642515202 (490h12m37.622867843s) [noise=true , address=77.90.31.16:4736 , piece_id=22WLC6TRH4VDWE6AGUDABPWCSBFQ4AICI23HRPESX57YSVANE4NA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.650528400 (490h12m37.630881035s) [noise=true , address=145.79.227.52:4445 , piece_id=P4LJCCMLGKNS4DUZDN62K3UNZ6GDKKJAJYGQPVV7YG5DMD3OFVAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653033468 (490h12m37.633386104s) [noise=true , address=145.79.227.11:4729 , piece_id=WWCZHN5LN6DPGO6DYPZFWRWPZSDPV3DJX3EBACMH6KIVJT3CCCAQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653554989 (490h12m37.633907636s) [noise=true , address=145.79.227.50:4374 , piece_id=I2UMEPN4WBIWOWHU37BQNNAY4WQFJA563XJNCF6R3KJIOVAGXEZQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.653672053 (490h12m37.6340247s) [noise=true , address=145.79.227.51:4409 , piece_id=BIJRIUYSJSAYS2ZZLZ42RW4J34NP2MQ4KI3MHA6QQBSKQWIT5VUQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.654069623 (490h12m37.634422267s) [noise=true , address=145.79.227.48:4301 , piece_id=E23RZD4YRMKDTR4NOXW6AXMBI274IBSPIXFYSEJDRI4ZDSOEKDTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.658467723 (490h12m37.638820361s) [noise=true , address=145.79.227.42:4121 , piece_id=L6I2JYP2S22VJKPHA3IEYJ3SWXGOWR6TWCDHOJ2SH7FMGOZCBLTQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660199041 (490h12m37.640551678s) [noise=true , address=45.91.116.12:4225 , piece_id=FTMNIH45XUYXMWJUHL36X7QCE36Z4HFMG75TTICVQUO7Y2NE5T5Q, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.660817119 (490h12m37.641169756s) [noise=true , address=145.79.227.47:4267 , piece_id=VCNI775XR73V3WBVTUVF26DBWUA66QAHTYITAEWE752M4LPZ27RA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.661736346 (490h12m37.642088988s) [noise=true , address=145.79.227.12:4765 , piece_id=AWQRNPWJ4HJQU25BZ5NULF6AKXW74DZLIRJZZRIDDWLFVP6HDRHA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.662358002 (490h12m37.642710641s) [noise=true , address=45.91.116.7:4011 , piece_id=SRX6GZOOXDNACQUT5XIW2TC2OBZN7AJWIN6TWL766FROET2P2PGA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670082883 (490h12m37.650435519s) [noise=true , address=145.79.227.45:4230 , piece_id=5BEY6NEZ2YUUOEKXMEQOQA333V7IBYF5NCABW5DT2ZIDSL7DTVFA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: <nil> Dec 26 01:40:57.670102888 (490h12m37.650455525s) [seg_pos={0 0}, upload=431275]: Segment reached optimal threshold of 13 pieces. Dec 26 01:40:57.670305063 (490h12m37.650657705s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670312909 (490h12m37.650665545s) [noise=true , address=145.79.227.39:4014 , piece_id=5KFTJX67KE4W7WLGVGMB6JUU5UOVLVXTDWWW23DB2BWKVPROW6JQ, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670453940 (490h12m37.650806583s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670469020 (490h12m37.650821656s) [noise=true , address=77.90.31.19:4842 , piece_id=D4YZNHCRNZCCQ5F234DTHXBE4H4FFG4EBB7MFYCVGPWKJAAJHRAA, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670587438 (490h12m37.650940084s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J): protocol: expected piece hash; context canceled; EOF Dec 26 01:40:57.670594485 (490h12m37.650947122s) [noise=true , address=145.79.227.40:4049 , piece_id=KXPK5VZSGQATOAWEQT3JSJ7AEXQUR4XHMFQSFQHR3VGBS56UN66A, seg_pos={0 0}, upload=431275]: Long tail cancellation due to optimal threshold Dec 26 01:40:57.670613018 (490h12m37.650965655s) [seg_pos={0 0}, upload=431275]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 26 01:40:57.670686219 (490h12m37.651038858s) [upload=431275]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 26 01:40:57.670692616 (490h12m37.651045255s) [upload=431275]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 26 01:40:57.799577368 (490h12m37.779930006s) [upload=431275]: Done uploading segments... Dec 26 01:40:57.799602093 (490h12m37.779954731s) [upload=431275]: Upload finished. err: <nil> Duration: 30.003005837s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.496636005s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:41:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.496663227s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.546122484s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:40:55 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.546153763s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.539542055s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:40:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.539627476s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.501290873s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:39:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.501317391s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.499618484s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:38:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.499651949s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.548121052s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:38:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.548152024s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.563918112s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:37:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.563946183s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.542837486s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:37:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.54286494s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.512468861s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:36:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.512496823s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.549057982s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:35:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.549083842s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.502096065s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:35:07 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.502125868s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.563584455s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:34:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.563620548s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.545930412s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:32:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.545952653s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.542253879s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:32:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.542313443s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.530412082s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:30:53 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.530437579s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.500793286s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:30:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.500822909s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.498586632s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:29:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.498891904s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.520869414s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:28:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.520915996s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.492582535s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:28:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.492627445s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.525997455s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:27:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.526019051s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.543703298s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:26:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.5437408s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.499236694s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:26:17 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.499260872s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.477787906s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:25:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.477818317s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.523816977s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:24:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.523846425s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.578265263s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:23:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.57829665s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.497931188s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:23:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.497953993s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.472553781s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:22:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.472580021s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.502699762s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:21:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.502728644s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 1.540747039s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:20:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.540774542s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.52236723s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:20:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.522399042s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.462387351s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:19:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.462416599s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.467285883s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:18:39 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.467316255s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.487406198s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:18:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.487485368s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.471985493s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:17:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.472017011s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.428466251s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:16:48 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.42849728s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.574278142s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:15:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.574304631s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.506079795s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:14:44 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.506105417s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.55378298s trace: https://jaeger.dev.storj.io/trace/73e9a0df4d4acf45 FAIL (2025-12-26 01:13:55 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.553810442s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)