Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.565542489s
FAIL (2025-08-17 19:41:43 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.56557643s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.541834743s
FAIL (2025-08-17 19:41:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.541865941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
854.317383ms
FAIL (2025-08-17 19:41:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 854.354813ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.539016516s
FAIL (2025-08-17 19:41:00 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.539147051s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.016359411s
FAIL (2025-08-17 19:40:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.016391131s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.583658178s
FAIL (2025-08-17 19:40:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.583712841s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.488131098s
FAIL (2025-08-17 19:40:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.488238409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.494934754s
FAIL (2025-08-17 19:39:55 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.49496281s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
852.641808ms
FAIL (2025-08-17 19:39:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 852.67039ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.118772429s
FAIL (2025-08-17 19:39:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 3.11880619s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.681489934s
FAIL (2025-08-17 19:39:23 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.681519585s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
936.787008ms
FAIL (2025-08-17 19:38:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 936.821748ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.76940986s
FAIL (2025-08-17 19:38:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.769441845s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
881.99429ms
FAIL (2025-08-17 19:38:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 882.025098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.479595997s
FAIL (2025-08-17 19:38:14 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.479628239s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.498799457s
FAIL (2025-08-17 19:38:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.498835983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
872.962189ms
FAIL (2025-08-17 19:37:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 873.003926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.495710007s
FAIL (2025-08-17 19:37:26 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.495738607s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.650238608s
FAIL (2025-08-17 19:37:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.650275664s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.476050837s
FAIL (2025-08-17 19:36:33 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.476087657s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
993.911796ms
FAIL (2025-08-17 19:36:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 993.952468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.517859453s
FAIL (2025-08-17 19:35:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.517944113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.660001153s
FAIL (2025-08-17 19:35:42 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.660048055s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
867.657268ms
FAIL (2025-08-17 19:35:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 867.704575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.735237979s
FAIL (2025-08-17 19:35:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.735269414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
934.583741ms
FAIL (2025-08-17 19:35:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 934.613728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.488968987s
FAIL (2025-08-17 19:34:40 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.48900716s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.654353614s
FAIL (2025-08-17 19:34:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.654383662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.050403826s
FAIL (2025-08-17 19:34:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.050429248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.481262882s
FAIL (2025-08-17 19:33:54 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.481291103s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.574353846s
FAIL (2025-08-17 19:33:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.574393227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.0806664s
FAIL (2025-08-17 19:32:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.080697394s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.505281568s
FAIL (2025-08-17 19:32:52 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.505327229s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
967.00244ms
FAIL (2025-08-17 19:32:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 967.033405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.643654211s
FAIL (2025-08-17 19:32:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.643746191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.403523898s
FAIL (2025-08-17 19:31:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.403552468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.53258115s
FAIL (2025-08-17 19:31:44 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.532612413s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
852.114741ms
FAIL (2025-08-17 19:31:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 852.204561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.015531753s
FAIL (2025-08-17 19:31:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.015565943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.492696345s
FAIL (2025-08-17 19:31:11 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.492725196s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.621610504s
FAIL (2025-08-17 19:31:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.621648492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.671826407s
FAIL (2025-08-17 19:30:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.671873806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.512297555s
FAIL (2025-08-17 19:30:31 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.512345522s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
886.576864ms
FAIL (2025-08-17 19:30:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 886.635014ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.488330485s
FAIL (2025-08-17 19:30:00 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.488371168s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.07991316s
FAIL (2025-08-17 19:29:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 1.079951353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.551435922s
FAIL (2025-08-17 19:29:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.551475327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.674885037s
FAIL (2025-08-17 19:29:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 19:18:35.618102758 (217h52m57.577200063s) [upload=226854]: Starting upload
Aug 17 19:18:35.618193872 (217h52m57.577291135s) [upload=226854]: Done starting upload
Aug 17 19:18:35.618329492 (217h52m57.577426729s) [upload=226854]: Uploading segments...
Aug 17 19:18:35.618737753 (217h52m57.577835019s) [upload=226854]: Got next segment. Inline: false
Aug 17 19:18:35.618815749 (217h52m57.577913007s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:18:35.618822795 (217h52m57.577920047s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 19:18:35.816850142 (217h52m57.775947394s) [seg_pos={0 0}, upload=226854]: Begin upload segment...
Aug 17 19:18:35.816922034 (217h52m57.776019279s) [seg_pos={0 0}, upload=226854]: Done begin upload segment.
Aug 17 19:18:35.817107927 (217h52m57.776205175s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817167847 (217h52m57.776265096s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.817507928 (217h52m57.776605176s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818262168 (217h52m57.777359423s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.818799474 (217h52m57.777896713s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820094684 (217h52m57.779191978s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.820721898 (217h52m57.779819149s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.821422400 (217h52m57.780519645s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822115608 (217h52m57.781212862s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.822925632 (217h52m57.782022882s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.825034755 (217h52m57.784132009s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.826971014 (217h52m57.786068268s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.828602642 (217h52m57.78769989s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.830390775 (217h52m57.789488027s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.832303384 (217h52m57.791400636s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833157374 (217h52m57.79225463s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.833678073 (217h52m57.792775327s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:35.835641187 (217h52m57.794738451s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Uploading piece...
Aug 17 19:18:36.374796463 (217h52m58.333893713s) [upload=226854]: Next returned nil segment
Aug 17 19:18:36.374818969 (217h52m58.333916224s) [upload=226854]: Waiting for error group managing segments...
Aug 17 19:18:36.579459970 (217h52m58.538557202s) [noise=true , address=77.90.31.21:4886 , piece_id=WQLZ6DCQFRGD5547757VPATV56W7FCG52BSU7LJ767WF7ZV2RICA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.587441618 (217h52m58.54653885s) [noise=true , address=77.90.31.15:4722 , piece_id=NTQWB3FIHIGAO5XR3AJOSCEP3EOYFE4INGT46USYTFXYVY5DVOSQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.596070042 (217h52m58.555167273s) [noise=true , address=45.91.116.5:4312 , piece_id=QBNWEVBX6ZCBYCKLBE4L5UMKTK2LITEX7VBWOOCJOTP5ZRRINZEQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599043777 (217h52m58.558141024s) [noise=true , address=104.36.82.23:4474 , piece_id=BLWGXQV4BHPX76KHCN6XHHX3UJ5BLPIJCZKVCUZZYFSCXSZQZWGA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599442704 (217h52m58.558539952s) [noise=true , address=104.36.82.17:4355 , piece_id=AAI6J4AIHC5ZLXR7AXHMXGY2FZML32BHLUZF2R5XIXKALG3XOEDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.599715270 (217h52m58.558812503s) [noise=true , address=77.90.31.19:4845 , piece_id=HRB7CVMQPDSY6VMGOOHBDDKZQVFVM63Y7Y5LXQDOFKSOYRPB3HFQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616505655 (217h52m58.575602896s) [noise=true , address=104.36.82.59:4319 , piece_id=BOVO53M23GGJQDTZBGQBRANK7PMH2FN3JQJQ46AOUV7WQ4KEUVLQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.616996854 (217h52m58.576094102s) [noise=true , address=104.36.82.21:4476 , piece_id=FRDUW5H4EO6RK4EWPXOHVUXSTXRL5FPDBNLKAPA7MBNGAUEHUG5A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.620249567 (217h52m58.579346803s) [noise=true , address=104.36.82.35:4582 , piece_id=WQ3ANRPTUWC36GQYT7F3VNCZJKJSB4IEKNHEO3VEJZPBG3V6KSDA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.628282483 (217h52m58.587379714s) [noise=true , address=104.36.82.49:4978 , piece_id=LA44SQN7PFDL43Q52OZBZN7MOD2ZMBLD742BVSBUNY6BUC3BBH4A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.660717300 (217h52m58.619814541s) [noise=true , address=45.91.116.4:4964 , piece_id=4INTZ4QSVXCPOEL7EVOHFIRSIVBMPOEILRRJ4VEPLREFJQ6U7GCQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.661387187 (217h52m58.620484419s) [noise=true , address=77.90.31.16:4755 , piece_id=4M34QDVLD7SFPKSHFGMYVAIEHYTLJI76CA3IX4CYDSWK5OYZFNLA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.664823583 (217h52m58.623920814s) [noise=true , address=104.36.82.34:4548 , piece_id=WG5JCS4DQBKUFGDAYHPGNBYNUMX2DUCJTC542UGPSAAY5VYSS7IQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676316641 (217h52m58.635413888s) [noise=true , address=104.36.82.18:4394 , piece_id=YGT7XXDMLXV47QUN24CLA5YWWI42TM3O3ZVYZWEVDDWXAIGD2QRQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: <nil>
Aug 17 19:18:36.676366775 (217h52m58.635464024s) [seg_pos={0 0}, upload=226854]: Segment reached optimal threshold of 14 pieces.
Aug 17 19:18:36.676525380 (217h52m58.635622618s) [noise=true , address=45.91.116.11:4120 , piece_id=TJUEWQS5YATI47H7LFPHCQZUDXAD7KTGTUGCNT77KPXRG3SG4FRA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676609299 (217h52m58.635706538s) [noise=true , address=77.90.31.13:4645 , piece_id=B5LE5DNC32L66BCNBH3BRGGGVDV6PSJTK62GFG7XMXX3YPLZS66A, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg): protocol: expected piece hash; context canceled; EOF
Aug 17 19:18:36.676682101 (217h52m58.63577934s) [noise=true , address=64.49.13.140:4509 , piece_id=UL43LBD4HWYQNMDCEWKRQCHA2FFOSXNEQQAQ2SAIY5QLKFLR7DBQ, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36228->64.49.13.140:4509: use of closed network connection
Aug 17 19:18:36.676774874 (217h52m58.635872113s) [noise=true , address=66.23.193.175:4559 , piece_id=AKXB2GVRL5RXZVAW6NCZEDH7KEXCRQ5567I55MWOSLNQR7WPE6XA, seg_pos={0 0}, upload=226854]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39522->66.23.193.175:4559: use of closed network connection
Aug 17 19:18:36.676826055 (217h52m58.635923308s) [seg_pos={0 0}, upload=226854]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 19:18:36.676925648 (217h52m58.636022894s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 19:18:36.676931514 (217h52m58.636028753s) [upload=226854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:18:36.848051296 (217h52m58.807148542s) [upload=226854]: Done uploading segments...
Aug 17 19:18:36.848085520 (217h52m58.807182755s) [upload=226854]: Upload finished. err: <nil>
Duration: 2.674924762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.704354837s
FAIL (2025-08-17 19:28:47 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.704419246s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
879.771038ms
FAIL (2025-08-17 19:28:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 17 19:10:06.127555095 (217h44m28.086652345s) [upload=226705]: Starting upload
Aug 17 19:10:06.127728335 (217h44m28.086825584s) [upload=226705]: Done starting upload
Aug 17 19:10:06.127849386 (217h44m28.08694666s) [upload=226705]: Uploading segments...
Aug 17 19:10:06.127994340 (217h44m28.087091598s) [upload=226705]: Got next segment. Inline: true
Aug 17 19:10:06.128003995 (217h44m28.087101351s) [upload=226705]: Waiting for error group managing segments...
Aug 17 19:10:06.128099824 (217h44m28.087197079s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 19:10:06.128107350 (217h44m28.087204602s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 17 19:10:06.128112043 (217h44m28.087209294s) [upload=226705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 19:10:06.622173403 (217h44m28.581270659s) [upload=226705]: Done uploading segments...
Aug 17 19:10:06.622199630 (217h44m28.581296884s) [upload=226705]: Upload finished. err: <nil>
Duration: 879.810926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|