Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...............X..........................X..............] duration:
836.17631ms
FAIL (2025-08-15 01:35:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.225409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X........X.X..X.......................] duration:
2.433071153s
FAIL (2025-08-15 01:35:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.433104034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X........X.X..X......................] duration:
2.51048463s
FAIL (2025-08-15 01:35:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.510540101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...............X..........................X.............] duration:
1.149332412s
FAIL (2025-08-15 01:34:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.149365102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...............X..........................X............] duration:
1.154357708s
FAIL (2025-08-15 01:34:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.154390132s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X........X.X..X.....................] duration:
2.638438111s
FAIL (2025-08-15 01:34:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.638476487s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...............X..........................X...........] duration:
915.155273ms
FAIL (2025-08-15 01:33:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.197678ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...............X..........................X..........] duration:
864.580336ms
FAIL (2025-08-15 01:33:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.61393ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...............X..........................X.........] duration:
863.3095ms
FAIL (2025-08-15 01:33:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.336056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X........X.X..X....................] duration:
2.849813123s
FAIL (2025-08-15 01:32:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.849850339s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...............X..........................X........] duration:
902.52185ms
FAIL (2025-08-15 01:32:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.551892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X........X.X..X...................] duration:
2.703669971s
FAIL (2025-08-15 01:31:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.70370427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...............X..........................X.......] duration:
836.410892ms
FAIL (2025-08-15 01:31:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 836.438939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X........X.X..X..................] duration:
2.459394197s
FAIL (2025-08-15 01:30:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.459426245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...............X..........................X......] duration:
893.700259ms
FAIL (2025-08-15 01:30:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 893.749146ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X........X.X..X.................] duration:
2.464041122s
FAIL (2025-08-15 01:29:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.464132502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...............X..........................X.....] duration:
941.412275ms
FAIL (2025-08-15 01:29:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 941.449316ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X........X.X..X................] duration:
2.387738114s
FAIL (2025-08-15 01:29:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.387777629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X...............X..........................X....] duration:
877.349343ms
FAIL (2025-08-15 01:28:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.407106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X........X.X..X...............] duration:
2.62565258s
FAIL (2025-08-15 01:27:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.625763397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X...............X..........................X...] duration:
813.303818ms
FAIL (2025-08-15 01:27:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 813.341822ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X........X.X..X..............] duration:
2.406921572s
FAIL (2025-08-15 01:27:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.406982763s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X...............X..........................X..] duration:
842.96597ms
FAIL (2025-08-15 01:26:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.006205ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X...............................X........X.X..X.............] duration:
2.531492801s
FAIL (2025-08-15 01:26:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.531522951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X...............................X........X.X..X............] duration:
2.535841393s
FAIL (2025-08-15 01:26:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.535887008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X...............X..........................X.] duration:
845.996651ms
FAIL (2025-08-15 01:25:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.03532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X...............................X........X.X..X...........] duration:
2.617201765s
FAIL (2025-08-15 01:25:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.617330647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X...............................X........X.X..X..........] duration:
2.417769871s
FAIL (2025-08-15 01:24:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.417810929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X...............X..........................X] duration:
359.023334ms
FAIL (2025-08-15 01:24:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 359.132122ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X...............................X........X.X..X.........] duration:
2.388004513s
FAIL (2025-08-15 01:24:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.388070446s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...............X..........................] duration:
888.459706ms
FAIL (2025-08-15 01:24:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 888.502653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...............X.........................] duration:
1.033014716s
FAIL (2025-08-15 01:23:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.033121583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X...............................X........X.X..X........] duration:
2.432456733s
FAIL (2025-08-15 01:23:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.432561004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............X........................] duration:
846.856605ms
FAIL (2025-08-15 01:23:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 846.8878ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X...............................X........X.X..X.......] duration:
2.445965727s
FAIL (2025-08-15 01:22:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.445992778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............X.......................] duration:
829.832495ms
FAIL (2025-08-15 01:22:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 829.86816ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X...............................X........X.X..X......] duration:
2.419697737s
FAIL (2025-08-15 01:21:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.41974764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X...............................X........X.X..X.....] duration:
2.367022751s
FAIL (2025-08-15 01:21:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.367058966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............X......................] duration:
939.985104ms
FAIL (2025-08-15 01:21:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 940.084071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X...............................X........X.X..X....] duration:
2.528269404s
FAIL (2025-08-15 01:21:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.528311058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............X.....................] duration:
1.002578008s
FAIL (2025-08-15 01:21:00 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.002614965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X...............................X........X.X..X...] duration:
2.531410164s
FAIL (2025-08-15 01:20:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.531446198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............X....................] duration:
865.76262ms
FAIL (2025-08-15 01:19:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 865.81194ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X...............................X........X.X..X..] duration:
2.444662954s
FAIL (2025-08-15 01:19:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.444695289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............X...................] duration:
852.756546ms
FAIL (2025-08-15 01:19:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 852.792642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X...............................X........X.X..X.] duration:
2.542020282s
FAIL (2025-08-15 01:19:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.542059578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...............X..................] duration:
1.038807229s
FAIL (2025-08-15 01:18:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 1.038911288s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X...............................X........X.X..X] duration:
1.646049583s
FAIL (2025-08-15 01:18:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 1.646080212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...............X.................] duration:
867.034635ms
FAIL (2025-08-15 01:17:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 01:04:47.473370483 (151h39m9.432467731s) [upload=158017]: Starting upload Aug 15 01:04:47.473412249 (151h39m9.4325095s) [upload=158017]: Done starting upload Aug 15 01:04:47.473469339 (151h39m9.432566575s) [upload=158017]: Uploading segments... Aug 15 01:04:47.473580692 (151h39m9.43267794s) [upload=158017]: Got next segment. Inline: true Aug 15 01:04:47.473586102 (151h39m9.432683348s) [upload=158017]: Waiting for error group managing segments... Aug 15 01:04:47.473626140 (151h39m9.432723385s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:04:47.473631391 (151h39m9.432728636s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:04:47.473634884 (151h39m9.432732129s) [upload=158017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:04:48.145886658 (151h39m10.104983903s) [upload=158017]: Done uploading segments... Aug 15 01:04:48.145929615 (151h39m10.10502686s) [upload=158017]: Upload finished. err: <nil>
Duration: 867.150463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X...............................X........X.X..] duration:
2.367944509s
FAIL (2025-08-15 01:17:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:16:13.411893619 (151h50m35.370990868s) [upload=158214]: Starting upload Aug 15 01:16:13.411947074 (151h50m35.37104432s) [upload=158214]: Done starting upload Aug 15 01:16:13.412160124 (151h50m35.371257383s) [upload=158214]: Uploading segments... Aug 15 01:16:13.412278005 (151h50m35.371375257s) [upload=158214]: Got next segment. Inline: false Aug 15 01:16:13.412344026 (151h50m35.371441278s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:16:13.412351094 (151h50m35.371448362s) [upload=158214]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 01:16:13.502059552 (151h50m35.461156787s) [upload=158214]: Next segment err: metaclient: Too Many Requests Aug 15 01:16:13.502096202 (151h50m35.461193453s) [upload=158214]: Done uploading segments... Aug 15 01:16:13.502114134 (151h50m35.461211379s) [upload=158214]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.367978603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|