Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X......X......X..............X................] duration:
914.230592ms
FAIL (2025-08-12 16:18:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 914.261268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.............X.......................................] duration:
2.626283278s
FAIL (2025-08-12 16:18:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.626316855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X......X......X..............X...............] duration:
1.016387397s
FAIL (2025-08-12 16:18:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.016419049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.............X......................................] duration:
2.528878865s
FAIL (2025-08-12 16:18:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.528907177s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X......X......X..............X..............] duration:
1.202318203s
FAIL (2025-08-12 16:17:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.202375098s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.............X.....................................] duration:
2.605789456s
FAIL (2025-08-12 16:17:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.605817683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X......X......X..............X.............] duration:
1.244002761s
FAIL (2025-08-12 16:17:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.244043477s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.............X....................................] duration:
2.402732425s
FAIL (2025-08-12 16:16:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.402760773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X......X......X..............X............] duration:
1.170691184s
FAIL (2025-08-12 16:16:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.170724348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.............X...................................] duration:
2.378822623s
FAIL (2025-08-12 16:15:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.37887965s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X......X......X..............X...........] duration:
971.420558ms
FAIL (2025-08-12 16:15:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 971.446989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X......X......X..............X..........] duration:
1.323927495s
FAIL (2025-08-12 16:14:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.323964476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..........X.............X..................................] duration:
2.873336336s
FAIL (2025-08-12 16:14:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.873363483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X......X......X..............X.........] duration:
1.028457836s
FAIL (2025-08-12 16:13:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.028489418s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..........X.............X.................................] duration:
2.497854951s
FAIL (2025-08-12 16:13:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.497887517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X......X......X..............X........] duration:
837.829471ms
FAIL (2025-08-12 16:13:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.849254ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..........X.............X................................] duration:
2.555207449s
FAIL (2025-08-12 16:12:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.555245092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X......X......X..............X.......] duration:
1.116292469s
FAIL (2025-08-12 16:12:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.116345352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..........X.............X...............................] duration:
2.513900108s
FAIL (2025-08-12 16:12:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.513933637s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...X..........X.............X..............................] duration:
2.767754029s
FAIL (2025-08-12 16:11:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.767787223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X......X......X..............X......] duration:
1.198399971s
FAIL (2025-08-12 16:11:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.198472606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........................X......X......X..............X.....] duration:
997.213415ms
FAIL (2025-08-12 16:11:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 997.250251ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [XX...X..........X.............X.............................] duration:
2.409533615s
FAIL (2025-08-12 16:10:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.409575525s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........................X......X......X..............X....] duration:
985.26518ms
FAIL (2025-08-12 16:10:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 985.294569ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.XX...X..........X.............X............................] duration:
2.653230024s
FAIL (2025-08-12 16:10:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.653263571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........................X......X......X..............X...] duration:
863.418405ms
FAIL (2025-08-12 16:10:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.448249ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..XX...X..........X.............X...........................] duration:
2.675101364s
FAIL (2025-08-12 16:10:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.675137839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...XX...X..........X.............X..........................] duration:
2.425226073s
FAIL (2025-08-12 16:09:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.42526144s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............................X......X......X..............X..] duration:
922.542484ms
FAIL (2025-08-12 16:09:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 922.60322ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....XX...X..........X.............X.........................] duration:
2.627225091s
FAIL (2025-08-12 16:09:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.627254059s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............................X......X......X..............X.] duration:
919.274047ms
FAIL (2025-08-12 16:09:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 919.348527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....XX...X..........X.............X........................] duration:
2.520765131s
FAIL (2025-08-12 16:08:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.520798863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............................X......X......X..............X] duration:
383.342124ms
FAIL (2025-08-12 16:08:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 16:08:27.003367509 (94h42m48.962464762s) [upload=98691]: Starting upload Aug 12 16:08:27.003521990 (94h42m48.962619244s) [upload=98691]: Done starting upload Aug 12 16:08:27.003621915 (94h42m48.96271915s) [upload=98691]: Uploading segments... Aug 12 16:08:27.003691534 (94h42m48.962788791s) [upload=98691]: Got next segment. Inline: true Aug 12 16:08:27.003697634 (94h42m48.962794887s) [upload=98691]: Waiting for error group managing segments... Aug 12 16:08:27.003801762 (94h42m48.962899015s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 16:08:27.003810477 (94h42m48.962907733s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 16:08:27.003843957 (94h42m48.962941207s) [upload=98691]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 16:08:27.104604615 (94h42m49.063701862s) [upload=98691]: Done uploading segments... Aug 12 16:08:27.104628016 (94h42m49.06372525s) [upload=98691]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.35929ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......XX...X..........X.............X.......................] duration:
2.637941426s
FAIL (2025-08-12 16:08:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.638050568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X......X......X..............] duration:
946.478328ms
FAIL (2025-08-12 16:07:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 946.524939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......XX...X..........X.............X......................] duration:
2.626303155s
FAIL (2025-08-12 16:07:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.626410243s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................X......X......X.............] duration:
1.147981454s
FAIL (2025-08-12 16:06:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 1.148017929s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........XX...X..........X.............X.....................] duration:
2.653672161s
FAIL (2025-08-12 16:06:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.653716485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X................................X......X......X............] duration:
1.036573279s
FAIL (2025-08-12 16:05:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 1.036593706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........XX...X..........X.............X....................] duration:
2.396480761s
FAIL (2025-08-12 16:05:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.396513013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........XX...X..........X.............X...................] duration:
2.799577191s
FAIL (2025-08-12 16:04:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.799604648s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X................................X......X......X...........] duration:
833.768865ms
FAIL (2025-08-12 16:04:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 833.804995ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........XX...X..........X.............X..................] duration:
3.14000725s
FAIL (2025-08-12 16:04:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 3.140046901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X................................X......X......X..........] duration:
992.686384ms
FAIL (2025-08-12 16:03:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 992.716798ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............XX...X..........X.............X.................] duration:
2.568369998s
FAIL (2025-08-12 16:03:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.568410207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X................................X......X......X.........] duration:
1.133825917s
FAIL (2025-08-12 16:02:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 1.133867438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............XX...X..........X.............X................] duration:
2.369444723s
FAIL (2025-08-12 16:02:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.369475894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X................................X......X......X........] duration:
870.444979ms
FAIL (2025-08-12 16:02:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 12 15:56:30.054258447 (94h30m52.013355705s) [upload=98488]: Starting upload
Aug 12 15:56:30.054387906 (94h30m52.013485157s) [upload=98488]: Done starting upload
Aug 12 15:56:30.054509828 (94h30m52.013607061s) [upload=98488]: Uploading segments...
Aug 12 15:56:30.054580852 (94h30m52.013678108s) [upload=98488]: Got next segment. Inline: true
Aug 12 15:56:30.054587040 (94h30m52.013684298s) [upload=98488]: Waiting for error group managing segments...
Aug 12 15:56:30.054657670 (94h30m52.013754918s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:56:30.054663567 (94h30m52.013760814s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 15:56:30.054667269 (94h30m52.013764515s) [upload=98488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:56:30.992944151 (94h30m52.952041408s) [upload=98488]: Done uploading segments...
Aug 12 15:56:30.992970763 (94h30m52.95206801s) [upload=98488]: Upload finished. err: <nil>
Duration: 870.467997ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............XX...X..........X.............X...............] duration:
2.400720817s
FAIL (2025-08-12 16:02:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.400763758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............XX...X..........X.............X..............] duration:
2.467818866s
FAIL (2025-08-12 16:01:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 12 15:50:53.904224961 (94h25m15.863322213s) [upload=98386]: Starting upload
Aug 12 15:50:53.904291062 (94h25m15.863388317s) [upload=98386]: Done starting upload
Aug 12 15:50:53.904417908 (94h25m15.86351518s) [upload=98386]: Uploading segments...
Aug 12 15:50:53.904586862 (94h25m15.863684107s) [upload=98386]: Got next segment. Inline: false
Aug 12 15:50:53.904640333 (94h25m15.863737582s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 15:50:53.904645305 (94h25m15.863742553s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 15:50:54.104059047 (94h25m16.063156292s) [seg_pos={0 0}, upload=98386]: Begin upload segment...
Aug 12 15:50:54.104107654 (94h25m16.063204902s) [seg_pos={0 0}, upload=98386]: Done begin upload segment.
Aug 12 15:50:54.104132022 (94h25m16.063229267s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104522528 (94h25m16.063619776s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.104809948 (94h25m16.063907197s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105089940 (94h25m16.064187185s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105362313 (94h25m16.064459561s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.105779833 (94h25m16.064877084s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.106774472 (94h25m16.065871725s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107173241 (94h25m16.066270489s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107211100 (94h25m16.066308352s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.107638080 (94h25m16.066735336s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108016587 (94h25m16.067113839s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108327453 (94h25m16.067424705s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108635106 (94h25m16.067732361s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.108852531 (94h25m16.067949782s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109157396 (94h25m16.068254641s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109516230 (94h25m16.068613478s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.109790644 (94h25m16.068887893s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.110056071 (94h25m16.069153325s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Uploading piece...
Aug 12 15:50:54.679649183 (94h25m16.638746419s) [upload=98386]: Next returned nil segment
Aug 12 15:50:54.680286494 (94h25m16.639383748s) [upload=98386]: Waiting for error group managing segments...
Aug 12 15:50:54.818979285 (94h25m16.778076531s) [noise=true , address=77.90.31.21:4883 , piece_id=BPITJBQ5DTOPDBBKUR7NZIAYN6SDA4QML632WDPGOSY6BWVT2FHA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.855007415 (94h25m16.814104648s) [noise=true , address=104.36.82.17:4342 , piece_id=NFDQOM3B57PD443J4RYCR2RFHOC5VQXX4TMQN7XGWGSD6HIHIIMQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.870369615 (94h25m16.829466854s) [noise=true , address=104.36.82.51:4054 , piece_id=Z3KDUY2EZMW5BVXDPKVY3MGHAMKLGNFMH2ZN55J5T3ZPX55CMMNA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.875126191 (94h25m16.83422343s) [noise=true , address=104.36.82.16:4311 , piece_id=CVY7OQ2ZX2KSQSHRAJMNJ7QMQHUQ3M3RNSHGCRVMNUQW3WJHZ6CQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.889695458 (94h25m16.848792697s) [noise=true , address=104.36.82.44:4897 , piece_id=3XIMVX47PE2HMXRPQYL7AESPG5YLELBYFMTAAJL2R5UVAWSHIAQQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.901886997 (94h25m16.860984239s) [noise=true , address=104.36.82.60:4361 , piece_id=7JP264OJF62TGSO7Z4NMO3AYU5Q6AJASSPDNETY6AJAAHC7BPAOA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.942473997 (94h25m16.901571228s) [noise=true , address=104.36.82.62:4410 , piece_id=EN3HG7YVWTRLMZZQEAZE7GI3A2WLWMFXMZZC3H3YAJCQFKOGJSXQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:54.975748679 (94h25m16.93484591s) [noise=true , address=79.127.220.101:4071 , piece_id=GRQWZWYZDWQXRYZ26PPWWVR5NTF6KGAOOZHT3N7RF4YCSEJIAU7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.022479916 (94h25m16.981577178s) [noise=true , address=104.36.82.35:4585 , piece_id=CRGBKQZLJAF6OMQO5EN6HJ4ZSCFW55S7JVPJWMYORVKS5MP7WL7Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.112401016 (94h25m17.071498264s) [noise=true , address=79.127.201.215:4359 , piece_id=SZCZEJM6BDYFTBO3QJQXHVNXXPLXD6I5HJJGHXCX3OVR4UUUGWIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.198205400 (94h25m17.157302653s) [noise=true , address=77.90.31.13:4642 , piece_id=6ODQDB6H6F7YIRALDAGLSQPN3PBFYMIXBZEPUQ57X4DRZCZYXRIQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.347447725 (94h25m17.30654497s) [noise=true , address=64.49.13.140:4506 , piece_id=OBDIL4NZMGDX4ILZRX4YJTIYH2OI5RXRSD3AIBWMP34KV4JBJLEQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.364806193 (94h25m17.32390343s) [noise=true , address=66.23.193.175:4563 , piece_id=K7F2YDQYT2CKSKXFRTHRXCBUZLLM6JFC5LOPFSBQXAHI5M6433GA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382118889 (94h25m17.341216142s) [noise=true , address=64.49.13.170:4722 , piece_id=2WRFYV7L4UR5GQMMVKCGBI6TMTCCAL7CIPVX6UGUABCY2NJGJQPA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: <nil>
Aug 12 15:50:55.382163147 (94h25m17.341260393s) [seg_pos={0 0}, upload=98386]: Segment reached optimal threshold of 14 pieces.
Aug 12 15:50:55.382393820 (94h25m17.341491066s) [noise=true , address=104.36.82.5:4850 , piece_id=DKTOZ3D5KTKZLD3ODX26732KUO7TB4BY73ALEQWA2GDQOJSFM76Q, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi): protocol: expected piece hash; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; write tcp 139.59.144.22:45438->104.36.82.5:4850: use of closed network connection; EOF
Aug 12 15:50:55.382579376 (94h25m17.341676628s) [noise=true , address=104.36.82.37:4675 , piece_id=HZN27CAFORPZAUOREEXZSDGS44ZEBXORZW7NQUC246LBYMDTKKPQ, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19mQfMQqZC6sHUUho7tMRRviqrgzp3ZFLvKGRbEnDpevLv3Xi6): protocol: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34884->104.36.82.37:4675: use of closed network connection
Aug 12 15:50:55.382694779 (94h25m17.341792031s) [noise=true , address=104.36.82.23:4456 , piece_id=2IMVQRCJIJ3LILVL4UA2PUIZ4RP5X3A65XPWIDJO6GWVP7XWMMDA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XUZ2ggL9Q4V8uyJdwvwztqCTvj1DFGRWGtYzKJiaRVaByhfTx): protocol: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33998->104.36.82.23:4456: use of closed network connection
Aug 12 15:50:55.382714885 (94h25m17.341812158s) [noise=true , address=104.36.82.39:4748 , piece_id=IID4MMTUBCBNF4A5X2C6QS6FLZI332YLRZUACUQ3HLIIXVSIA7AA, seg_pos={0 0}, upload=98386]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: read tcp 139.59.144.22:60336->104.36.82.39:4748: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 15:50:55.382736138 (94h25m17.341833393s) [seg_pos={0 0}, upload=98386]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 15:50:55.382849484 (94h25m17.341946738s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 15:50:55.382856369 (94h25m17.341953624s) [upload=98386]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 15:50:55.564166688 (94h25m17.523263938s) [upload=98386]: Done uploading segments...
Aug 12 15:50:55.564190035 (94h25m17.523287285s) [upload=98386]: Upload finished. err: <nil>
Duration: 2.467908881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|