Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
471.210611ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 09:52:56 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": context deadline exceeded
Duration: 471.241247ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
448.144111ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 09:51:47 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": context deadline exceeded
Duration: 448.184886ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
501.73569ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 09:51:18 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": context deadline exceeded
Duration: 501.806289ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.306508824s
FAIL (2025-07-13 09:51:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.306548592s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
510.332104ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 09:50:51 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": context deadline exceeded
Duration: 510.354857ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.292966397s
FAIL (2025-07-13 09:50:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.293007909s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
446.662264ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-13 09:50:13 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": context deadline exceeded
Duration: 446.680868ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.275478925s
FAIL (2025-07-13 09:50:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.275513817s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.301105916s
FAIL (2025-07-13 09:49:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.301140615s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.316486542s
FAIL (2025-07-13 09:48:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.316528686s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.274247445s
FAIL (2025-07-13 09:47:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.274284591s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.303025393s
FAIL (2025-07-13 09:47:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.303068347s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.263866229s
FAIL (2025-07-13 09:46:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.263915525s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.355719436s
FAIL (2025-07-13 09:45:38 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.355756143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.311942839s
FAIL (2025-07-13 09:44:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.31206743s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.279936792s
FAIL (2025-07-13 09:43:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.279967473s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.362468324s
FAIL (2025-07-13 09:42:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.362568296s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.379510485s
FAIL (2025-07-13 09:40:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.379546428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.336226234s
FAIL (2025-07-13 09:40:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.336269595s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.471904177s
FAIL (2025-07-13 09:39:31 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.471932151s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.388764908s
FAIL (2025-07-13 09:38:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.388853656s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.342259064s
FAIL (2025-07-13 09:37:38 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.342289202s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.548979439s
FAIL (2025-07-13 09:37:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.549002085s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.470175498s
FAIL (2025-07-13 09:36:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.470198808s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.33954229s
FAIL (2025-07-13 09:35:30 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.339576898s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.454927574s
FAIL (2025-07-13 09:35:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.45516484s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.303849833s
FAIL (2025-07-13 09:33:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.303877776s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.339780015s
FAIL (2025-07-13 09:33:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.339808425s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
731.651806ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:33:24 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 731.681201ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
615.319043ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:32:43 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 615.342435ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.324888238s
FAIL (2025-07-13 09:32:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.324927498s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.406793181s
FAIL (2025-07-13 09:31:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.406839657s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
674.367409ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:31:33 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 674.394159ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.440634898s
FAIL (2025-07-13 09:31:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.440668353s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
738.209198ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:30:24 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 738.230706ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.368909851s
FAIL (2025-07-13 09:30:08 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.369005683s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
795.436865ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:29:18 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 795.464038ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.681689365s
FAIL (2025-07-13 09:29:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.681745964s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
741.802008ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:28:33 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 741.826463ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.309992132s
FAIL (2025-07-13 09:27:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.31003093s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
619.999404ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:27:24 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 620.024357ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.437324905s
FAIL (2025-07-13 09:27:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.437353736s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
610.464252ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:27:05 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 610.489424ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
597.144575ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:26:42 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 597.176584ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.417700774s
FAIL (2025-07-13 09:26:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.417730304s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
605.098519ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:26:00 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 605.120473ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.314767851s
FAIL (2025-07-13 09:25:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.31479616s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.307744495s
FAIL (2025-07-13 09:25:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
15.879359357 (479h50m15.762772973s) [noise=true , address=104.36.82.10:4078 , piece_id=MVSC2PWEVM7MJWFRFOPL6K4LUPQF527U7MABU6KITN4APFRMGYIA, seg_pos={0 0}, upload=383721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: expected piece hash; context canceled; EOF
Jul 13 09:01:15.879378431 (479h50m15.762792047s) [seg_pos={0 0}, upload=383721]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:01:15.879507951 (479h50m15.762921581s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:01:15.879515439 (479h50m15.762929075s) [upload=383721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:01:16.079466680 (479h50m15.962880314s) [upload=383721]: Done uploading segments...
Jul 13 09:01:16.079490971 (479h50m15.962904599s) [upload=383721]: Upload finished. err: <nil>
Jul 13 09:02:18.560591855 (479h51m18.444005467s) [upload=383735]: Starting upload
Jul 13 09:02:18.560683888 (479h51m18.4440975s) [upload=383735]: Done starting upload
Jul 13 09:02:18.560819123 (479h51m18.44423274s) [upload=383735]: Uploading segments...
Jul 13 09:02:18.561056871 (479h51m18.444470489s) [upload=383735]: Got next segment. Inline: false
Jul 13 09:02:18.561171324 (479h51m18.444584961s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 13 09:02:18.561182400 (479h51m18.444596036s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 13 09:02:18.734211378 (479h51m18.617624995s) [seg_pos={0 0}, upload=383735]: Begin upload segment...
Jul 13 09:02:18.734277070 (479h51m18.617690685s) [seg_pos={0 0}, upload=383735]: Done begin upload segment.
Jul 13 09:02:18.734301314 (479h51m18.617714943s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734315258 (479h51m18.617728887s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.734752272 (479h51m18.618165899s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.738960946 (479h51m18.622374576s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739031319 (479h51m18.622444952s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739446933 (479h51m18.622860562s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.739784515 (479h51m18.623198143s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740204904 (479h51m18.623618535s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740597178 (479h51m18.624010812s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.740905027 (479h51m18.624318653s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741241645 (479h51m18.624655275s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741524198 (479h51m18.624937829s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.741863414 (479h51m18.625277043s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742300189 (479h51m18.625713822s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742407854 (479h51m18.625821486s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:18.742686016 (479h51m18.626099634s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Uploading piece...
Jul 13 09:02:19.335409942 (479h51m19.218823554s) [upload=383735]: Next returned nil segment
Jul 13 09:02:19.335433349 (479h51m19.218846975s) [upload=383735]: Waiting for error group managing segments...
Jul 13 09:02:19.468643526 (479h51m19.352057138s) [noise=true , address=77.90.31.15:4699 , piece_id=UBTNGGE3WPRP2CIS5LURS5JHJX6OD3J6DKOCTDJTKMI7OSA7X3ZQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.476301575 (479h51m19.359715188s) [noise=true , address=77.90.31.21:4877 , piece_id=HRDKDDTJTDTZ7DSJVNR5JEH6QF5OXAJLAAOEF3ZYB46TLQMAQCNA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.479773999 (479h51m19.363187619s) [noise=true , address=45.91.116.12:4227 , piece_id=HNNOH3SASAZIDJOZI3277D67BR7D4NVHX7YLZJLW5PLFUNMJZCWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480630990 (479h51m19.364044607s) [noise=true , address=77.90.31.11:4553 , piece_id=QHSDDDPLCXMX2D332EU765ZYU4ZEVS5Y3WZUIE43ZLVOKKNVWBUQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.480746630 (479h51m19.364160246s) [noise=true , address=77.90.31.14:4662 , piece_id=7LBNZ56ZB7O6W56JGMX7CE2CSHFVIWKLJA4GSIHSNG5CPKFI7QKA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.481117685 (479h51m19.364531313s) [noise=true , address=77.90.31.17:4771 , piece_id=W7BLT2I63WP2JJVYPYOLIFFI3EDSSR6IBXIALN4XTPW2EQJBMGWQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.484494144 (479h51m19.367907764s) [noise=true , address=45.91.116.5:4297 , piece_id=2IMYDYDBLJBXQ6D3ZKZELGJXOXY2DJISP77BSGAUHANRC7JDBLUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.487336277 (479h51m19.370749893s) [noise=true , address=45.91.116.13:4153 , piece_id=YMNJYBR7O6TR2GHEBZ525DXJKQ634K4CHE5XT2JICNWEY4MEUCMQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.489536202 (479h51m19.372949815s) [noise=true , address=45.91.116.14:4191 , piece_id=HZJHLE3FVC7HWWBE2L272QRJP5E5VBQBDRU2XDI5362WCGD6IMPA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.490175480 (479h51m19.373589092s) [noise=true , address=45.91.116.7:4009 , piece_id=7E4JAT6JUONGQBTYI4W3IDE6ZW4NB6UU2YMCFWTGWJSASN6OVSCQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.491624631 (479h51m19.37503826s) [noise=true , address=45.91.116.13:4154 , piece_id=NIKF7GCQMSAJA2D3HNFQBAZUKA2IBVNI3HE4A34QHGHHHN2EYFUA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.492140874 (479h51m19.375554487s) [noise=true , address=45.91.116.11:4119 , piece_id=TRMEM6UJCX3NVDRXEQROFIEE4U3S3DI2TY25EKCR4PQNUOYAEHLA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500428868 (479h51m19.383842494s) [noise=true , address=45.91.116.6:4975 , piece_id=DNYBFTFKFGFLSECCPGHSC4RAYFQFXY2SXMN7MCT6BE2Q2IQUMB7Q, seg_pos={0 0}, upload=383735]: Done uploading piece. err: <nil>
Jul 13 09:02:19.500457660 (479h51m19.383871287s) [seg_pos={0 0}, upload=383735]: Segment reached optimal threshold of 13 pieces.
Jul 13 09:02:19.500804687 (479h51m19.384218304s) [noise=true , address=104.36.82.11:4113 , piece_id=EKYWOJBZYKXOMTDMQC5IGYVKLYYCXGZTGJYAYHPSOG3GQG4LNIXQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500860551 (479h51m19.384274171s) [noise=true , address=104.36.82.12:4149 , piece_id=KWQFNGQSTXMFXGNXPT35SKAHKQX3PC3SIFSUADDHKRRBRJSTNNOQ, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500870526 (479h51m19.384284143s) [noise=true , address=45.91.116.10:4082 , piece_id=TTYJQHKGFNX6DEDZ4SMRU6YTCITQM7AADVRT7AUPDL4ZJES3FNWA, seg_pos={0 0}, upload=383735]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: expected piece hash; context canceled; EOF
Jul 13 09:02:19.500895393 (479h51m19.384309011s) [seg_pos={0 0}, upload=383735]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 13 09:02:19.500977700 (479h51m19.384391315s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 13 09:02:19.500983507 (479h51m19.384397124s) [upload=383735]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 13 09:02:19.645970073 (479h51m19.529383691s) [upload=383735]: Done uploading segments...
Jul 13 09:02:19.645991689 (479h51m19.529405309s) [upload=383735]: Upload finished. err: <nil>
Duration: 2.307775099s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
572.11514ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:25:05 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 572.142096ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
577.948147ms remote:
"tcp:5.161.37.179:443" response headers:
Access-Control-Allow-Origin=* Date=Sun, 13 Jul 2025 08:47:48 GMT Content-Length=11 Content-Type=text/plain; charset=utf-8 target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-13 09:24:36 UTC)
orbiter warning: unexpected status code "502 Bad Gateway" "Bad Gateway"
Duration: 577.967344ms
edge
ipfs
us1
|