Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.4277794s FAIL (2025-06-24 15:54:13 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.427808612s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 813.570918ms FAIL (2025-06-24 15:53:37 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 813.605525ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.535670157s FAIL (2025-06-24 15:53:32 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.535705013s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 633.353447ms FAIL (2025-06-24 15:53:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 633.376585ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.433000968s FAIL (2025-06-24 15:53:09 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.433030587s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.955812971s FAIL (2025-06-24 15:52:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.955872217s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.304957558s FAIL (2025-06-24 15:52:03 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.304988792s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.864865792s FAIL (2025-06-24 15:51:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.864896832s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 723.915602ms FAIL (2025-06-24 15:50:56 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 723.945941ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.843493458s FAIL (2025-06-24 15:50:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.843525607s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.398916191s FAIL (2025-06-24 15:50:11 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.398952678s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 841.820755ms FAIL (2025-06-24 15:50:11 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 841.852251ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.887243937s FAIL (2025-06-24 15:49:41 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.887275423s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 867.155345ms FAIL (2025-06-24 15:49:28 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 867.189514ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.950430995s FAIL (2025-06-24 15:49:16 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.950476563s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.811553098s FAIL (2025-06-24 15:48:59 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.812689617s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 859.095012ms FAIL (2025-06-24 15:48:29 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 859.130895ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.877208165s FAIL (2025-06-24 15:48:13 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.877237749s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.894529651s FAIL (2025-06-24 15:48:07 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.894587448s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 814.277521ms FAIL (2025-06-24 15:47:50 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 814.303056ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 3.048045732s FAIL (2025-06-24 15:47:19 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 3.048092104s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X....................X......................................] duration: 3.047696886s FAIL (2025-06-24 15:47:03 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 3.047725283s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.449011996s FAIL (2025-06-24 15:47:02 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 3.449044702s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.880901827s FAIL (2025-06-24 15:46:46 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.880932459s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.145289662s FAIL (2025-06-24 15:46:46 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 1.145321176s edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X....................X.....................................] duration: 2.424367621s FAIL (2025-06-24 15:46:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.42439751s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 3.245994932s FAIL (2025-06-24 15:46:01 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 3.246019791s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 660.844821ms FAIL (2025-06-24 15:45:56 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 660.880796ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 665.232195ms FAIL (2025-06-24 15:45:36 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 665.274213ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X....................X....................................] duration: 2.571182516s FAIL (2025-06-24 15:45:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.571217267s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X....................X...................................] duration: 2.624626764s FAIL (2025-06-24 15:44:58 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.624660213s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.988831295s FAIL (2025-06-24 15:44:54 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.988850486s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 849.743242ms FAIL (2025-06-24 15:44:42 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 849.772055ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 3.344564578s FAIL (2025-06-24 15:44:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 3.344596267s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X....................X..................................] duration: 2.737996728s FAIL (2025-06-24 15:44:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.738049921s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 648.456593ms FAIL (2025-06-24 15:44:11 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 648.482438ms edge authservice http bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 630.870422ms FAIL (2025-06-24 15:43:47 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 630.921999ms edge authservice http bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X....................X.................................] duration: 2.575317997s FAIL (2025-06-24 15:43:45 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.575355269s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 830.87683ms FAIL (2025-06-24 15:43:25 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 830.920175ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 3.654635847s FAIL (2025-06-24 15:43:23 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 3.654764436s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X....................X................................] duration: 3.098643848s FAIL (2025-06-24 15:43:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 3.098678782s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.920989616s FAIL (2025-06-24 15:42:29 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.921012871s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X....................X...............................] duration: 2.687986142s FAIL (2025-06-24 15:42:22 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.688023245s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 671.464844ms FAIL (2025-06-24 15:42:18 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 671.506352ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.877042502s FAIL (2025-06-24 15:41:51 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.877073808s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 653.481581ms FAIL (2025-06-24 15:41:39 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 653.530405ms edge authservice http bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.931665477s FAIL (2025-06-24 15:41:26 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 2.931760634s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X....................X..............................] duration: 2.521093502s FAIL (2025-06-24 15:41:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.521127992s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........X....................X.............................] duration: 2.526714979s FAIL (2025-06-24 15:41:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer ======LOGS====== (30h9m57.569988099s) [upload=24239]: Got next segment. Inline: false Jun 24 15:20:57.686619305 (30h9m57.570032934s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 15:20:57.686638888 (30h9m57.570052517s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 15:20:57.928224467 (30h9m57.811638102s) [seg_pos={0 0}, upload=24239]: Begin upload segment... Jun 24 15:20:57.928301679 (30h9m57.811715319s) [seg_pos={0 0}, upload=24239]: Done begin upload segment. Jun 24 15:20:57.928337777 (30h9m57.811751414s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928406629 (30h9m57.811820265s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.928863827 (30h9m57.812277463s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929025477 (30h9m57.81243913s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929286116 (30h9m57.812699754s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929564621 (30h9m57.812978257s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.929730217 (30h9m57.813143832s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930153445 (30h9m57.813567083s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930242518 (30h9m57.813656153s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930630185 (30h9m57.81404382s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.930638645 (30h9m57.814052284s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931017196 (30h9m57.814430834s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931132509 (30h9m57.814546156s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931366452 (30h9m57.81478014s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931564988 (30h9m57.814978626s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.931785078 (30h9m57.815198715s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932199806 (30h9m57.815613443s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:57.932597121 (30h9m57.816010761s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Uploading piece... Jun 24 15:20:58.481271254 (30h9m58.364684873s) [upload=24239]: Next returned nil segment Jun 24 15:20:58.481353797 (30h9m58.364767428s) [upload=24239]: Waiting for error group managing segments... Jun 24 15:20:58.655262482 (30h9m58.53867612s) [noise=true , address=104.36.82.42:6802 , piece_id=7OSAF24B3TPOSYMJWZWDFUO6UBKNYX3ZPIGUY2SYAEZ4G4G4DYFQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.657655175 (30h9m58.541068803s) [noise=true , address=77.90.31.16:4743 , piece_id=3DSZF64GBM22EGJKQROQGPLGEHKVNW34JSHOXUDF74RQIEJKESIQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.662068056 (30h9m58.545481674s) [noise=true , address=79.127.219.48:4081 , piece_id=VQIGSE2XEF6HBXVW4VQDZLCNTBF5TZGVJZXBUADXBLVWRYOM5WZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.666971693 (30h9m58.550385332s) [noise=true , address=104.36.82.55:4199 , piece_id=D4ZEWYMPJV7AWA5N25XBNSONSV7ZDRBQZ5CY325NI763DYGDYUWA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.673154612 (30h9m58.556568247s) [noise=true , address=104.36.82.3:4776 , piece_id=EQSOKKZXG4LZJ4DVRRZ5YZ6HCZ6SZ55PH47OATBJAWZZK26KRSHQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.677822189 (30h9m58.561235808s) [noise=true , address=77.90.31.21:4912 , piece_id=ACMFKAM6XWOBQ3SQ7KJFLBFW2FK3ZET7EB7UYOP4RX4UYXK3QRLQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.684887890 (30h9m58.568301504s) [noise=true , address=104.36.82.41:4795 , piece_id=75DNQGGA47MHOAS2X4DKCHMU6GB3NLCYK2WB7RZM53S3PRSR35RA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.690528248 (30h9m58.573941867s) [noise=true , address=104.36.82.12:4166 , piece_id=TJ5O4LAAUC25VCCVXPTFJEF2UNRCFMNE5EV4XTC7RMNH3OX3GKJA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.701981027 (30h9m58.58539464s) [noise=true , address=104.36.82.56:4246 , piece_id=75VOW7N366ZHGJIEVBFXA3XBDQ5CRF5BHECIITMBNZ5YF6HX2WVA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.709947868 (30h9m58.593361508s) [noise=true , address=104.36.82.53:4129 , piece_id=A6HRILO4AOFP2DXL2N36SYIMNQI33EUFKV6O4YLVGMT6IAC2WFHA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.713191677 (30h9m58.596605305s) [noise=true , address=104.36.82.34:4574 , piece_id=HWNI73D3I3RRRTOXA6YL7DAXR2NOPEUMMU77JPEWCSRHF7QW4SXQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.729487718 (30h9m58.612901353s) [noise=true , address=104.36.82.10:4096 , piece_id=GOB7J2EY6YDOGXAQ3K2AY6OKWGDOVMZQVKA4ZD4CKTTOHPYPBNNA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.749570660 (30h9m58.632984293s) [noise=true , address=45.91.116.8:4062 , piece_id=G6AM54EJGNC446AJ72XGH2UTF27O5H5WV2MXLHYTGXQQDGK7OMPQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846275930 (30h9m58.729689563s) [noise=true , address=79.127.220.101:6061 , piece_id=F2EHY2WPVGI5AJYTI7RAKL7TIQEAEXNPQ5KYFWEOH4PDTWCBS5FA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: <nil> Jun 24 15:20:58.846340737 (30h9m58.729754371s) [seg_pos={0 0}, upload=24239]: Segment reached optimal threshold of 14 pieces. Jun 24 15:20:58.846632560 (30h9m58.730046195s) [noise=true , address=104.36.82.14:4232 , piece_id=Z73NGQAPCHA5E5OLEFDB5765FQOKDZ6554V7FE5QEC4UBEJJPCZQ, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jWewg226E4BrBxqcK38n4ZjHx3toQeNdbc5HeU2EoykztXwyX): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846836814 (30h9m58.730250441s) [noise=true , address=64.49.13.170:4719 , piece_id=QS7G3PAFGIDQL7CYO3YOYCPZVFRHOD57U4NBLJMQBBOHERVTEZXA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126nRFki7uLyG9xwY8t6BeAumn8ME2HwccdC2EAwsiEV1p2juZ9): protocol: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41510->64.49.13.170:4719: use of closed network connection Jun 24 15:20:58.846884087 (30h9m58.730297723s) [noise=true , address=156.146.43.225:4467 , piece_id=3ASI2Q5YZ3OHFU6NCIK4OWMGXNSFVK3LXBG4O252I3FOGMJ7AVCA, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eTYJjTHAyM7gvmxrtzHMjFxCCQRzs6fgkVX7Rjj1ze9nVXjwr): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846899396 (30h9m58.730313025s) [noise=true , address=79.127.220.97:4370 , piece_id=GQVHIQNND7U4WQYK5CVGD4VFRGB6CAUSKCGE22VAZK3CTNRF6N3Q, seg_pos={0 0}, upload=24239]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12H9d6LpjXV9CHf3BenRN8M1uYNMF6ULNFnZzprJZsktsXCdoQb): protocol: expected piece hash; context canceled; EOF Jun 24 15:20:58.846918006 (30h9m58.730331619s) [seg_pos={0 0}, upload=24239]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 24 15:20:58.847033031 (30h9m58.73044668s) [upload=24239]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 15:20:58.847051227 (30h9m58.730464859s) [upload=24239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 15:21:38.513456613 (30h10m38.396870249s) [upload=24239]: Done uploading segments... Jun 24 15:21:38.513493889 (30h10m38.396907528s) [upload=24239]: Upload finished. err: metaclient: manager closed: closed: read tcp 139.59.144.22:34230->34.150.199.48:7777: read: connection reset by peer Duration: 2.526808056s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 901.027197ms FAIL (2025-06-24 15:40:59 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 901.132026ms edge authservice http bgp us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)