Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.374164017s FAIL (2025-07-18 12:52:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.374197447s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.459739562s FAIL (2025-07-18 12:51:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.459773151s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.634880056s FAIL (2025-07-18 12:51:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.634923613s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.418689584s FAIL (2025-07-18 12:51:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.418801826s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.591654723s FAIL (2025-07-18 12:50:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.591687352s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.414132315s FAIL (2025-07-18 12:50:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.414164459s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.892723283s FAIL (2025-07-18 12:50:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.892760956s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.671769418s FAIL (2025-07-18 12:49:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.671801542s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.320691127s FAIL (2025-07-18 12:49:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.320725487s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.473881356s FAIL (2025-07-18 12:49:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.473919749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.676766649s FAIL (2025-07-18 12:48:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.676797943s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.369282784s FAIL (2025-07-18 12:48:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.369316846s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.899686067s FAIL (2025-07-18 12:47:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.899716536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.358737714s FAIL (2025-07-18 12:47:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.358760767s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.413811668s FAIL (2025-07-18 12:46:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.413842133s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.542794471s FAIL (2025-07-18 12:46:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.542822481s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.656500816s FAIL (2025-07-18 12:46:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.656538479s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.538250713s FAIL (2025-07-18 12:45:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.53827597s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.656582532s FAIL (2025-07-18 12:45:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.656610311s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.542501781s FAIL (2025-07-18 12:45:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.542540889s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.66316654s FAIL (2025-07-18 12:45:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.663204137s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.551189957s FAIL (2025-07-18 12:44:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.551222454s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.389917848s FAIL (2025-07-18 12:44:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.389948771s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.409660754s FAIL (2025-07-18 12:44:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.409697761s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.778152284s FAIL (2025-07-18 12:43:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.77818711s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.298229154s FAIL (2025-07-18 12:43:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.298275155s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.75011484s FAIL (2025-07-18 12:42:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.750146243s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.367678742s FAIL (2025-07-18 12:42:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.367771708s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.593997324s FAIL (2025-07-18 12:41:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.594078693s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.375235185s FAIL (2025-07-18 12:41:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.375267753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.413934371s FAIL (2025-07-18 12:40:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.413965299s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.797756698s FAIL (2025-07-18 12:40:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.797804297s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.145180246s FAIL (2025-07-18 12:40:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 3.145283943s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.489702613s FAIL (2025-07-18 12:39:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.489731015s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.642801304s FAIL (2025-07-18 12:39:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.642835861s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.386684559s FAIL (2025-07-18 12:38:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.386781348s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.623377892s FAIL (2025-07-18 12:38:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.623409156s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.382779208s FAIL (2025-07-18 12:38:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.382880198s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.765799826s FAIL (2025-07-18 12:37:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.765832207s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.375387942s FAIL (2025-07-18 12:37:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.375420407s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.34744679s FAIL (2025-07-18 12:37:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.347478538s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.409344221s FAIL (2025-07-18 12:37:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.409379229s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.581923879s FAIL (2025-07-18 12:36:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.581954448s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.328344998s FAIL (2025-07-18 12:36:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.328388684s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.797822648s FAIL (2025-07-18 12:36:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.797943312s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.596090226s FAIL (2025-07-18 12:35:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.596213605s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.425556388s FAIL (2025-07-18 12:35:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.425590167s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 3.289416271s FAIL (2025-07-18 12:35:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 3.28944623s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 4.41553515s FAIL (2025-07-18 12:34:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== estItem_SegmentBegin Jul 18 12:13:33.620392272 (603h2m33.503805888s) [seg_pos={0 0}, upload=482147]: Begin upload segment... Jul 18 12:13:33.620453056 (603h2m33.503866676s) [seg_pos={0 0}, upload=482147]: Done begin upload segment. Jul 18 12:13:33.620494932 (603h2m33.503908562s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620500819 (603h2m33.503914451s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620905481 (603h2m33.504319113s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.620934724 (603h2m33.504348357s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621307624 (603h2m33.504721252s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621637637 (603h2m33.505051267s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.621886175 (603h2m33.505299802s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622021271 (603h2m33.505434904s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622324956 (603h2m33.505738588s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622569416 (603h2m33.505983029s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.622806676 (603h2m33.506220308s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623296793 (603h2m33.506710429s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623518504 (603h2m33.50693214s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.623790530 (603h2m33.507204156s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624033161 (603h2m33.507446793s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624144799 (603h2m33.507558431s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624501018 (603h2m33.507914648s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:33.624733995 (603h2m33.508147627s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Uploading piece... Jul 18 12:13:34.189792676 (603h2m34.073206312s) [upload=482147]: Next returned nil segment Jul 18 12:13:34.189817685 (603h2m34.073231318s) [upload=482147]: Waiting for error group managing segments... Jul 18 12:13:34.331211397 (603h2m34.214625009s) [noise=true , address=45.91.116.9:4283 , piece_id=AEYFP3WJB7T3V7KBY4CCZDCITOHRJ7KE3H7ZQHUPEACPWHB2KEYA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.344160118 (603h2m34.22757374s) [noise=true , address=45.91.116.14:4193 , piece_id=6EX7WNHS3GDEQC3RRDUPRY3DHYADVWKLUGPKBSRZJ2URA5Q2MTAA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.347105813 (603h2m34.23051943s) [noise=true , address=45.91.116.7:4031 , piece_id=H3PZRJYRVMM6JUDJBRRE7IF7WSF6B4XEHYHGY4S4J34YJOQPU7IQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.349058714 (603h2m34.232472333s) [noise=true , address=79.127.219.38:4023 , piece_id=3UQLEARQ5EQNY26WLIHBXTSCC44Q2PI76KEZLN3YQWE6PBR73LQQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.367227155 (603h2m34.250640774s) [noise=true , address=77.90.31.19:4868 , piece_id=TLFODQ6CPVWQKFXZMZ24HBW2KFSISPIWJGQVG4K4BLDNKVTTI6FA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.410633895 (603h2m34.294047529s) [noise=true , address=79.127.219.48:4082 , piece_id=5VAAIJBGYVT7YTVJWDMGQISS4OJEAPLZP43F3XAAUGZVUEALK7JA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.510862380 (603h2m34.394276009s) [noise=true , address=45.91.95.5:4013 , piece_id=5ACOTNNWUXY2LRDJEDKX43XFR2THEDDTVDOL6IEQGV4KEIJLWANQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.530632900 (603h2m34.41404653s) [noise=true , address=45.91.95.4:4004 , piece_id=P4QBLXZAIOWRG6AFQUDPQDF4IAZQP6W2DFKIIHULRJTBXKMJHGYQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.567043418 (603h2m34.45045705s) [noise=true , address=79.127.201.215:4344 , piece_id=SHRROJHGGJ3K43DOVGIILV5HDFKJESWFH5R4AEKXLJX7NWHLMFMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.903974872 (603h2m34.78738849s) [noise=true , address=79.127.205.245:4237 , piece_id=IHKGH3R7OXUGPWN5G24TQPRFMX7YUJ5555S4BMSTOSIHPSZVLZCA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:34.919166831 (603h2m34.802580447s) [noise=true , address=79.127.205.233:4628 , piece_id=ZZ2RAQP65MMFNU53UQKFXRR4QPMKJMEVM3GZAZDFOELWPMQ5PSWA, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:13:35.318955896 (603h2m35.202369514s) [noise=true , address=45.91.116.12:4245 , piece_id=GMKIQQKMH3VNH5TUFET2UNQZAV2FOLS22TNQYEWJSXLS5QOHJZ4Q, seg_pos={0 0}, upload=482147]: Done uploading piece. err: <nil> Jul 18 12:14:33.152770912 (603h3m33.03618453s) [noise=true , address=77.90.31.10:4544 , piece_id=HQ5NI3S2XMCQUD3ROOHDIZUN62P3242MPJGZEAWUSCK5ZAZCSPMQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE, address:77.90.31.10:4544): protocol: write tcp 139.59.144.22:38070->77.90.31.10:4544: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152837337 (603h3m33.036250954s) [noise=true , address=77.90.31.15:4709 , piece_id=NVHHUBQDCG5YT2CLUI3DSOU5ALKVOE47TJUKQYJ5MNCFRAT6DRDQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1CrHsLV4vge154tJjMvbo5oxnphfukuXQBKfvTjA43n6CJM2Ah, address:77.90.31.15:4709): protocol: write tcp 139.59.144.22:35908->77.90.31.15:4709: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.152882004 (603h3m33.036295622s) [noise=true , address=77.90.31.13:4641 , piece_id=MNDISFBSOAOUTJSRNQC523M5CC4MLRVH4WAS3TAFRNUCYFJTSGHQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:187b9r6f2MK5c5mJEVasrhfpRHzhC4JbkWTbVvHuqB62XYs8xL, address:77.90.31.13:4641): protocol: write tcp 139.59.144.22:60742->77.90.31.13:4641: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153121796 (603h3m33.036535415s) [noise=true , address=77.90.31.16:4757 , piece_id=IKHQAHNZASFBPTVCK7HE3HREEAWP5GWPDZHBAU4EALF55MIN3GIQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1gjesgEXSFr1aGyFgASrVRJgEHTne1KichuGqXwMjN1hHBt4kz, address:77.90.31.16:4757): protocol: write tcp 139.59.144.22:36646->77.90.31.16:4757: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153168438 (603h3m33.036582053s) [noise=true , address=77.90.31.12:4613 , piece_id=O6ZGBAXU2UV6HBIHZU4K5LRTMKKXC6GI63VTDYFHRRT46EX7Z53A, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:1223QFHVZJ198KV6fEfCeyEzt7C3qP2zY84ocB71DJzY61rAMGF, address:77.90.31.12:4613): protocol: write tcp 139.59.144.22:42646->77.90.31.12:4613: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:14:33.153391026 (603h3m33.036804643s) [noise=true , address=77.90.31.11:4557 , piece_id=33SQ5A3RML2B77H4BDXU7SQ24WN2SXUEV64RGVXTCIZ6EBLLHDAQ, seg_pos={0 0}, upload=482147]: Done uploading piece. err: ecclient: upload failed (node:12jhwkR5WaB34mEb6JJP2Lnyvo4HdkghJeR3PGz1hTDs12oV6uX, address:77.90.31.11:4557): protocol: write tcp 139.59.144.22:48542->77.90.31.11:4557: use of closed network connection; context deadline exceeded Jul 18 12:14:33.153415039 (603h3m33.036828654s) [seg_pos={0 0}, upload=482147]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Jul 18 12:14:33.271003419 (603h3m33.154417038s) [upload=482147]: Done uploading segments... Jul 18 12:14:33.271053119 (603h3m33.154466738s) [upload=482147]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 4.415570094s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.374587343s FAIL (2025-07-18 12:34:10 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== twork connection; conn closed: op; piecestore: piecestore close: context canceled Jul 18 12:13:36.059334855 (603h2m35.942748487s) [seg_pos={0 0}, upload=482150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 12:13:36.059429166 (603h2m35.942842897s) [upload=482150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 12:13:36.059435794 (603h2m35.942849427s) [upload=482150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 12:13:36.222045265 (603h2m36.105458897s) [upload=482150]: Done uploading segments... Jul 18 12:13:36.222068360 (603h2m36.105481987s) [upload=482150]: Upload finished. err: <nil> Jul 18 12:14:39.658268712 (603h3m39.541682338s) [upload=482161]: Starting upload Jul 18 12:14:39.658371478 (603h3m39.541785116s) [upload=482161]: Done starting upload Jul 18 12:14:39.658518044 (603h3m39.54193168s) [upload=482161]: Uploading segments... Jul 18 12:14:39.658896930 (603h3m39.542310547s) [upload=482161]: Got next segment. Inline: false Jul 18 12:14:39.658985463 (603h3m39.542399092s) [upload=482161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 12:14:39.658990950 (603h3m39.542404576s) [upload=482161]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 12:14:39.770564164 (603h3m39.65397778s) [seg_pos={0 0}, upload=482161]: Begin upload segment... Jul 18 12:14:39.770628215 (603h3m39.654041844s) [seg_pos={0 0}, upload=482161]: Done begin upload segment. Jul 18 12:14:39.770660270 (603h3m39.654073903s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770686400 (603h3m39.654100038s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.770748767 (603h3m39.654162397s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771127939 (603h3m39.654541566s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771181512 (603h3m39.654595145s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.771620867 (603h3m39.655034504s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.774266589 (603h3m39.657680227s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776315497 (603h3m39.659729122s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776661976 (603h3m39.660075608s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.776932615 (603h3m39.660346241s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777195553 (603h3m39.66060918s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777496856 (603h3m39.660910481s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.777781639 (603h3m39.661195265s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778068328 (603h3m39.661481955s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778350883 (603h3m39.661764511s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:39.778821109 (603h3m39.662234744s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Uploading piece... Jul 18 12:14:40.395675287 (603h3m40.279088924s) [upload=482161]: Next returned nil segment Jul 18 12:14:40.395694996 (603h3m40.279108633s) [upload=482161]: Waiting for error group managing segments... Jul 18 12:14:40.525012265 (603h3m40.408425892s) [noise=true , address=45.91.116.9:4262 , piece_id=WD6Y5RRCTTKBNO7GB5ZUCRFKUSYXV7NIQZPZV3X4DGYYTS4JTZVQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.525513556 (603h3m40.408927173s) [noise=true , address=45.91.116.13:4153 , piece_id=7OW2QFFUPR4E2JT3EIWDFSPCNVYUSBC25TYYTCDCJBGCK5VMTMOQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.529347087 (603h3m40.412760705s) [noise=true , address=45.91.116.5:4297 , piece_id=IT7WPAMTGLRCXVTDVPXN4LNPBOHDBWFX7KL23E3TVJE2NKW74APQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.530235891 (603h3m40.413649507s) [noise=true , address=45.91.116.7:4009 , piece_id=6RNBTQCZ2BUOQ22NZ5U2IHTAP7PX5YVWXKLH24R2LLAHMENLXQ4Q, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.532741510 (603h3m40.416155123s) [noise=true , address=77.90.31.11:4554 , piece_id=R6SI3DQS4TBIDCUEONSKUAXIWH3RR2STUIZE5DVWSBNLNFAONHPQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.534588102 (603h3m40.41800172s) [noise=true , address=45.91.116.8:4047 , piece_id=X3GG25HH5X5CJCOSZUWFVCB4MCSEX56MCWX6XOFOV5JRQKID3TGA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.538981731 (603h3m40.422395355s) [noise=true , address=45.91.116.13:4154 , piece_id=DTOA6BCE6BKOKJWBPFG6VAKSDWUBT4BQOJMGKJZPVDKUB5B32JJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.543710393 (603h3m40.427124056s) [noise=true , address=45.91.116.14:4191 , piece_id=NB6T54P7GRT7N45BY35JKDUNIGRMFISPYAZSZOWNLGK2RJQTSBJQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.548841144 (603h3m40.432254761s) [noise=true , address=45.91.116.4:4937 , piece_id=WK5ORWNSEHZMB5A3IR6A2TOIVDY7TG2FDKZIGVOK36SLDT5R7MKQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.557391011 (603h3m40.440804638s) [noise=true , address=104.36.82.8:4972 , piece_id=LDGQX6RQHVIG57FPC3T5P6QRSAZMW6XXMEG5OBP3CNHGPBKR2ORA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:14:40.569693712 (603h3m40.453107329s) [noise=true , address=104.36.82.6:4875 , piece_id=GVZXOQX4CW6SC3OKEPLCPMY6INQBKL2E2UPB4NRDITPYYG3T6WCQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: <nil> Jul 18 12:15:09.384201015 (603h4m9.267614643s) [noise=true , address=77.90.31.10:4517 , piece_id=BF4AEPQD5AJF4V2VLF3OKW3Y4KBBLACEF64R3CPM63AF4AYQGEFA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: context deadline exceeded; context deadline exceeded Jul 18 12:15:09.384430897 (603h4m9.267844524s) [noise=true , address=77.90.31.19:4843 , piece_id=CKH5OODEYI2J5NBAS5CTSWKMV7YX3Y5Q3ACZOJ5XP527FOLIPNWQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 139.59.144.22:53078->77.90.31.19:4843: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384565274 (603h4m9.267978904s) [noise=true , address=77.90.31.13:4627 , piece_id=4RH6UEARJCYQ2T6HGGMYZ76FMQWMUMPRPRMLCLCOIPAU67CVPKBA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:35388->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384616598 (603h4m9.26803027s) [noise=true , address=77.90.31.15:4698 , piece_id=QSEXFMDYV5IYP6YNFWIU4DAIPJ7EVSPENB5ILXPK5ZZ4OJO4MXCA, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384633074 (603h4m9.268046702s) [noise=true , address=77.90.31.12:4590 , piece_id=ZJDAZYZ4FJRUUYJPIYWQVV6BSH6QMHGVX6DG3A7RNI2IRKVTASMQ, seg_pos={0 0}, upload=482161]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 139.59.144.22:33514->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 12:15:09.384666892 (603h4m9.268080522s) [seg_pos={0 0}, upload=482161]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jul 18 12:15:09.504847872 (603h4m9.388261498s) [upload=482161]: Done uploading segments... Jul 18 12:15:09.504890933 (603h4m9.388304554s) [upload=482161]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 2.374611769s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)