Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
277.205457ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:43:09 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 277.236392ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
861.110031ms
FAIL (2025-08-14 15:42:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.141926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.945854568s
FAIL (2025-08-14 15:42:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.945885692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
278.370325ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:42:10 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 278.415004ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
877.191078ms
FAIL (2025-08-14 15:41:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.224851ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.940534605s
FAIL (2025-08-14 15:41:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.940569741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
267.362494ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:41:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 267.391862ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
841.36303ms
FAIL (2025-08-14 15:41:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 841.399053ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
270.392182ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:40:50 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 270.427692ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.631155451s
FAIL (2025-08-14 15:40:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.631188861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.029048849s
FAIL (2025-08-14 15:40:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.029082843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.492329763s
FAIL (2025-08-14 15:40:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.492393559s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
342.45206ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:39:51 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 342.479854ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.610239317s
FAIL (2025-08-14 15:39:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.610296772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
978.475981ms
FAIL (2025-08-14 15:39:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 978.504689ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
274.378024ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:39:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.405286ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.739972649s
FAIL (2025-08-14 15:38:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.740012715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
953.447953ms
FAIL (2025-08-14 15:38:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 953.482145ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
273.98703ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:38:10 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.050785ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.788116569s
FAIL (2025-08-14 15:37:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.788153545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
876.051207ms
FAIL (2025-08-14 15:37:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.083078ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
275.533746ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:37:11 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 275.563004ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.71983617s
FAIL (2025-08-14 15:36:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.719867229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
273.503984ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:36:44 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 273.552391ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.980180026s
FAIL (2025-08-14 15:36:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.980215915s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.022059761s
FAIL (2025-08-14 15:36:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.022111634s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.589856659s
FAIL (2025-08-14 15:36:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.589888381s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
278.722555ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:36:16 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 278.746964ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
296.258295ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:35:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 296.285321ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
918.674355ms
FAIL (2025-08-14 15:35:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 918.707434ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.652310212s
FAIL (2025-08-14 15:35:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.652356165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
270.881786ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:34:47 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 270.913835ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
968.678123ms
FAIL (2025-08-14 15:34:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 968.711318ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.728108979s
FAIL (2025-08-14 15:34:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.728139718s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
269.859642ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:33:52 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 269.918329ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.008400077s
FAIL (2025-08-14 15:33:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.008429483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.851607316s
FAIL (2025-08-14 15:33:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.851642189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
268.721604ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:33:06 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 268.753468ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.410837566s
FAIL (2025-08-14 15:32:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.410879106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
274.41147ms target:
https://us1.storj.io/login
FAIL (2025-08-14 15:32:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 274.432745ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001121585s target:
https://us1.storj.io/login
FAIL (2025-08-14 15:32:14 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout
Duration: 30.001155227s
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.926989386s
FAIL (2025-08-14 15:32:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.92701623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.670314645s
FAIL (2025-08-14 15:31:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.670361888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.017438543s
FAIL (2025-08-14 15:31:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.017485787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.467390192s
FAIL (2025-08-14 15:30:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.467425573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.06289825s
FAIL (2025-08-14 15:30:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.063143622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.729044046s
FAIL (2025-08-14 15:29:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.729081182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
839.553495ms
FAIL (2025-08-14 15:29:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 839.637218ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.74084124s
FAIL (2025-08-14 15:29:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 15:29:04.838937778 (142h3m26.798035044s) [upload=147968]: Starting upload
Aug 14 15:29:04.839041282 (142h3m26.798138589s) [upload=147968]: Done starting upload
Aug 14 15:29:04.839595545 (142h3m26.798692791s) [upload=147968]: Uploading segments...
Aug 14 15:29:04.839876313 (142h3m26.798973561s) [upload=147968]: Got next segment. Inline: false
Aug 14 15:29:04.839926136 (142h3m26.799023391s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 15:29:04.840055638 (142h3m26.799152895s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 15:29:05.043506498 (142h3m27.002603747s) [seg_pos={0 0}, upload=147968]: Begin upload segment...
Aug 14 15:29:05.043578242 (142h3m27.002675491s) [seg_pos={0 0}, upload=147968]: Done begin upload segment.
Aug 14 15:29:05.044453731 (142h3m27.003550989s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.044630715 (142h3m27.00372796s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045471192 (142h3m27.004655021s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.045643630 (142h3m27.004740878s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046388267 (142h3m27.005485512s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.046562364 (142h3m27.005659612s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051474253 (142h3m27.010571491s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.051740833 (142h3m27.010838092s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052023310 (142h3m27.01112056s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052842546 (142h3m27.01193978s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052862876 (142h3m27.011960108s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.052996592 (142h3m27.012093835s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053133875 (142h3m27.012231108s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053255414 (142h3m27.012352645s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053358790 (142h3m27.012456023s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053473182 (142h3m27.012570418s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053585996 (142h3m27.012683228s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.053726567 (142h3m27.012823816s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Uploading piece...
Aug 14 15:29:05.607784172 (142h3m27.566881411s) [upload=147968]: Next returned nil segment
Aug 14 15:29:05.607804345 (142h3m27.56690159s) [upload=147968]: Waiting for error group managing segments...
Aug 14 15:29:05.748514776 (142h3m27.707612027s) [noise=true , address=77.90.31.13:4652 , piece_id=UNESRTZOJDAM5ITO6BU57T6MTJM4EAUVFW4RHIW5KVXSS6NHB4TQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.788573648 (142h3m27.747670895s) [noise=true , address=104.36.82.5:4846 , piece_id=PEZDDVMJY2XDGODEMV6E5LOH74AIE7QVJIQHIKYRCWFWYRHFHSZA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794177971 (142h3m27.753275209s) [noise=true , address=104.36.82.60:4366 , piece_id=FBW6U427TPMYMZAFHPKVDRP7WZATE26S2D7NEYQQVOFTF27BO7DA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.794440129 (142h3m27.753537378s) [noise=true , address=77.90.31.12:4597 , piece_id=UZ4D75EMBMQZKC4P55POSCFNQVTLG6A2S7CC6WBWLGM5QGPJ5XUQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.821835635 (142h3m27.780932891s) [noise=true , address=77.90.31.18:4836 , piece_id=RRFTHTMKVHLWMKM6NOVPICPLMBNDPS7D35GE4MAJRCKODAWNIVKA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.830795175 (142h3m27.789892414s) [noise=true , address=104.36.82.46:4509 , piece_id=ISDYJJBBPCWD43DQZTHJF33RKTXZE3CDN6ATAM3NVYNLZVDEZD7A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.835789379 (142h3m27.794886634s) [noise=true , address=104.36.82.34:4545 , piece_id=XTEF7ZIM3AXN5RDQMD245IQTCWTLZPPSYGUIFP6XPYIKKYMCPMQQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841529067 (142h3m27.800626301s) [noise=true , address=104.36.82.4:4825 , piece_id=MXUDNDO3FEOCHABUU75W3OL2C6SSQ5CEPPDMNBJUGIZXMVU7TEXA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.841556128 (142h3m27.800653421s) [noise=true , address=104.36.82.58:4286 , piece_id=O5ONIAGLGZO2PDOYD6GUH42DZJQPJNYLT64EFGBTDDS7RGDR3QPA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.843614245 (142h3m27.802711481s) [noise=true , address=104.36.82.18:4387 , piece_id=F63PGNIXZB55QEI6XZAGCWSMNGKUCU47KPJ32QS7VVY4FKMSXV3Q, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.886775726 (142h3m27.845872965s) [noise=true , address=104.36.82.44:4873 , piece_id=EKHTB4RRCOALXXAKNQP4HPPJKJ7RJ7WB7JRT365FJLPQSOGJBZIA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.898163001 (142h3m27.857260251s) [noise=true , address=77.90.31.21:4881 , piece_id=6V3VBGJSOLVL4SDTAKSJCGR4LXJS7HQAQDYUD4RSWPMVDWTL557A, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.901968347 (142h3m27.861065585s) [noise=true , address=104.36.82.2:4764 , piece_id=D45TISXIS6U7BFFVPIAZGLIWHR5POKGQC7KPHPDK4UKUB4RFC4GA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947145737 (142h3m27.906242989s) [noise=true , address=79.127.220.101:4074 , piece_id=UPD2JD5D7OHE2VDUP24HBNYXTTSLSTL6VUX7LGCUSXULHSQKPGPQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: <nil>
Aug 14 15:29:05.947176161 (142h3m27.906273416s) [seg_pos={0 0}, upload=147968]: Segment reached optimal threshold of 14 pieces.
Aug 14 15:29:05.947356983 (142h3m27.906454232s) [noise=true , address=79.127.201.215:4326 , piece_id=ZM3GBTRUJ2AU5RC22VVVM2OMBE6WE4UDJC5LOFDA5JPOQHIC52CA, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DQjacBMunpwHhi3XBWf9rupVS3nxhbSurbMXm6k7zAQsgcQsP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947656592 (142h3m27.90675384s) [noise=true , address=77.90.31.15:4714 , piece_id=VA2KPMFKKW4IZI5XFRTYHTVTA6WL5YWLHJ4TBYJ2XOFKZUNXAKMQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DTMJVUhaPKvEnvujCAk9byGb88QsevLbtCBB9R1mxS4DxShiP): protocol: expected piece hash; context canceled; EOF
Aug 14 15:29:05.947911760 (142h3m27.907009009s) [noise=true , address=104.36.82.23:4474 , piece_id=7FB2YCHLXSAHJUA2MQJZ7PTYGZ2SWDJLU7VUUPFDTLNJXIH4D2DQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51436->104.36.82.23:4474: use of closed network connection
Aug 14 15:29:05.948119138 (142h3m27.907216391s) [noise=true , address=66.23.193.175:4557 , piece_id=3AZE7M4MAFBZI75HUAZRN4TQITKNX3P2WRRIQQPA3MDPQ6WXMSCQ, seg_pos={0 0}, upload=147968]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47432->66.23.193.175:4557: use of closed network connection
Aug 14 15:29:05.948140768 (142h3m27.907238025s) [seg_pos={0 0}, upload=147968]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 15:29:05.948256727 (142h3m27.907353982s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 15:29:05.948262739 (142h3m27.907359996s) [upload=147968]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 15:29:07.028962448 (142h3m28.9880597s) [upload=147968]: Done uploading segments...
Aug 14 15:29:07.029005342 (142h3m28.988102583s) [upload=147968]: Upload finished. err: <nil>
Duration: 2.74088009s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
947.333659ms
FAIL (2025-08-14 15:28:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 15:18:06.542496348 (141h52m28.501593584s) [upload=147773]: Starting upload Aug 14 15:18:06.542573504 (141h52m28.501670756s) [upload=147773]: Done starting upload Aug 14 15:18:06.542658537 (141h52m28.501755771s) [upload=147773]: Uploading segments... Aug 14 15:18:06.542713996 (141h52m28.50181125s) [upload=147773]: Got next segment. Inline: true Aug 14 15:18:06.542719993 (141h52m28.501817246s) [upload=147773]: Waiting for error group managing segments... Aug 14 15:18:06.542773998 (141h52m28.501871253s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 15:18:06.542780338 (141h52m28.501877584s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 15:18:06.542784580 (141h52m28.501881833s) [upload=147773]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 15:18:06.633617455 (141h52m28.59271469s) [upload=147773]: Done uploading segments... Aug 14 15:18:06.633642518 (141h52m28.592739766s) [upload=147773]: Upload finished. err: metaclient: Too Many Requests
Duration: 947.371551ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|