Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X....................XX..................X............] duration:
862.102898ms
FAIL (2025-08-15 06:54:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 862.166978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X.....X...................X.X.........XX.................] duration:
2.352383082s
FAIL (2025-08-15 06:54:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.352442023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X....................XX..................X...........] duration:
1.096155658s
FAIL (2025-08-15 06:53:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 1.096243742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X.....X...................X.X.........XX................] duration:
2.411440982s
FAIL (2025-08-15 06:53:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.411486987s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X....................XX..................X..........] duration:
847.315466ms
FAIL (2025-08-15 06:53:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 847.342829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X.....X...................X.X.........XX...............] duration:
2.447647879s
FAIL (2025-08-15 06:53:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.447677565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X....................XX..................X.........] duration:
977.696382ms
FAIL (2025-08-15 06:52:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 977.73129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X.....X...................X.X.........XX..............] duration:
2.535764079s
FAIL (2025-08-15 06:52:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.535801778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X....................XX..................X........] duration:
832.405498ms
FAIL (2025-08-15 06:52:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 832.442405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X....................XX..................X.......] duration:
819.094153ms
FAIL (2025-08-15 06:51:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 819.12451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X.....X...................X.X.........XX.............] duration:
2.465975441s
FAIL (2025-08-15 06:51:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.466072227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X.....X...................X.X.........XX............] duration:
2.382169414s
FAIL (2025-08-15 06:50:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.382220563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X....................XX..................X......] duration:
990.703701ms
FAIL (2025-08-15 06:50:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 990.743975ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X....................XX..................X.....] duration:
997.770921ms
FAIL (2025-08-15 06:50:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 997.806163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X.....X...................X.X.........XX...........] duration:
2.589298851s
FAIL (2025-08-15 06:49:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.58934646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X.....X...................X.X.........XX..........] duration:
2.437100799s
FAIL (2025-08-15 06:48:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.437135415s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X....................XX..................X....] duration:
813.749182ms
FAIL (2025-08-15 06:48:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 813.835704ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X.....X...................X.X.........XX.........] duration:
2.41518589s
FAIL (2025-08-15 06:47:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.415290806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..............X....................XX..................X...] duration:
956.475092ms
FAIL (2025-08-15 06:47:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 956.529085ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..............X....................XX..................X..] duration:
808.388767ms
FAIL (2025-08-15 06:47:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 808.435321ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............X.....X...................X.X.........XX........] duration:
2.317946555s
FAIL (2025-08-15 06:47:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.317989912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..............X....................XX..................X.] duration:
853.209575ms
FAIL (2025-08-15 06:46:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 853.248774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............X.....X...................X.X.........XX.......] duration:
2.416080522s
FAIL (2025-08-15 06:46:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.416144078s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X..............X....................XX..................X] duration:
950.212973ms
FAIL (2025-08-15 06:46:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 2da28ed4271e8c589f8fa745d8b7a69912359fafdcf0f001f4f0e48fa0e7f5ba != before 3c84b1516a5b475ea0d349e92d981e1daa92d1ac17ac22fd5eb0b6ea68524c62 ======LOGS====== Aug 15 06:46:30.922498385 (157h20m52.88159563s) [upload=163904]: Starting upload Aug 15 06:46:30.922544144 (157h20m52.881641396s) [upload=163904]: Done starting upload Aug 15 06:46:30.922628599 (157h20m52.881725844s) [upload=163904]: Uploading segments... Aug 15 06:46:30.922681691 (157h20m52.881778941s) [upload=163904]: Got next segment. Inline: true Aug 15 06:46:30.922687301 (157h20m52.881784548s) [upload=163904]: Waiting for error group managing segments... Aug 15 06:46:30.922741311 (157h20m52.881838556s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:46:30.922746586 (157h20m52.881843831s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:46:30.922750067 (157h20m52.881847313s) [upload=163904]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:46:31.290643352 (157h20m53.249740588s) [upload=163904]: Done uploading segments... Aug 15 06:46:31.290663976 (157h20m53.24976121s) [upload=163904]: Upload finished. err: <nil>
Duration: 950.243162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..............X....................XX..................] duration:
1.033814737s
FAIL (2025-08-15 06:46:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.033873931s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X.....X...................X.X.........XX......] duration:
2.730136934s
FAIL (2025-08-15 06:45:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.730170103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............X....................XX.................] duration:
815.514225ms
FAIL (2025-08-15 06:45:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.564964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X.....X...................X.X.........XX.....] duration:
2.377751262s
FAIL (2025-08-15 06:45:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.37777861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..............X....................XX................] duration:
876.282379ms
FAIL (2025-08-15 06:45:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.335345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X.....X...................X.X.........XX....] duration:
2.749212215s
FAIL (2025-08-15 06:44:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.749243715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..............X....................XX...............] duration:
1.127787315s
FAIL (2025-08-15 06:44:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.127815819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..............X....................XX..............] duration:
849.424286ms
FAIL (2025-08-15 06:44:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 849.461087ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X.....X...................X.X.........XX...] duration:
2.365768698s
FAIL (2025-08-15 06:43:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.365803005s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................X.....X...................X.X.........XX..] duration:
2.494192775s
FAIL (2025-08-15 06:43:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.494225163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X..............X....................XX.............] duration:
932.224455ms
FAIL (2025-08-15 06:43:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 932.329326ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...................X.....X...................X.X.........XX.] duration:
2.301598365s
FAIL (2025-08-15 06:42:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 2.301712609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X..............X....................XX............] duration:
812.403713ms
FAIL (2025-08-15 06:42:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.448922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................X.....X...................X.X.........XX] duration:
1.962078078s
FAIL (2025-08-15 06:42:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:42:24.140153370 (157h16m46.099250609s) [upload=163827]: Starting upload
Aug 15 06:42:24.140256416 (157h16m46.099353655s) [upload=163827]: Done starting upload
Aug 15 06:42:24.140403407 (157h16m46.099500651s) [upload=163827]: Uploading segments...
Aug 15 06:42:24.140751220 (157h16m46.099848466s) [upload=163827]: Got next segment. Inline: false
Aug 15 06:42:24.140800726 (157h16m46.099897971s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:42:24.140806190 (157h16m46.099903438s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:42:24.337616384 (157h16m46.296713633s) [seg_pos={0 0}, upload=163827]: Begin upload segment...
Aug 15 06:42:24.337679787 (157h16m46.296777041s) [seg_pos={0 0}, upload=163827]: Done begin upload segment.
Aug 15 06:42:24.337711329 (157h16m46.296808576s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.337741632 (157h16m46.29683889s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338282778 (157h16m46.297380022s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338344952 (157h16m46.297442209s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338639732 (157h16m46.297736986s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.338815000 (157h16m46.297912251s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339019554 (157h16m46.298116905s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339395854 (157h16m46.298493102s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.339685990 (157h16m46.298783235s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340090541 (157h16m46.299187796s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340496948 (157h16m46.299594202s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.340912922 (157h16m46.30001018s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341299004 (157h16m46.300396259s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341610645 (157h16m46.300707897s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.341946406 (157h16m46.301043661s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342299425 (157h16m46.301396676s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342451127 (157h16m46.301548382s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.342807983 (157h16m46.301905235s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Uploading piece...
Aug 15 06:42:24.905637021 (157h16m46.864734267s) [upload=163827]: Next returned nil segment
Aug 15 06:42:24.905666874 (157h16m46.864764118s) [upload=163827]: Waiting for error group managing segments...
Aug 15 06:42:25.053071964 (157h16m47.0121692s) [noise=true , address=77.90.31.21:4900 , piece_id=P4MSIVNHPLJUSMTIRX7Y77DM34A4NXHCWDMHQ6PUTMBM6RCOPEAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.055389242 (157h16m47.014486481s) [noise=true , address=104.36.82.22:4524 , piece_id=WTI6AYDBZMNOKK7QWI7X6UFHENPRQZDIYLMS2QBQCSNN6Z5RQUBA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.057988195 (157h16m47.01708544s) [noise=true , address=77.90.31.15:4701 , piece_id=7FVYZ2RD4EBHRDYTV5WDAWA2P2B4UPXUHDS47G4D26UVLC7EW7RQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.067918482 (157h16m47.027015729s) [noise=true , address=77.90.31.14:4693 , piece_id=YJQQV2U2FWYBXIBAMAC5AIK5XHKWUQWI75DG5HPMK3RNSH6ROAPA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.076460253 (157h16m47.035557499s) [noise=true , address=104.36.82.58:4277 , piece_id=VUCN7C34RDKUNDKKLFFXWVTUGCTJUJST667S6BH5UHV4J3TKFKAQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.081393204 (157h16m47.040490452s) [noise=true , address=45.91.116.10:4111 , piece_id=HSWA34SBFBGKAEGJIAT6XKRDCYDN7YHMEE2TD3YPVXD3SEBQGHLQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.087484543 (157h16m47.046581837s) [noise=true , address=104.36.82.23:4446 , piece_id=CQK5CQ5G2AMQRKDZHJOZ5PZBWA7NTEYYBNB67UTB2IV334TZKBJQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.100658032 (157h16m47.059755278s) [noise=true , address=104.36.82.36:4651 , piece_id=7WI7T3GHCN4QG34UWSYCRODW6IZQK77ZBLOOH357HALKOS4MEVEQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.110180689 (157h16m47.069277935s) [noise=true , address=104.36.82.5:4852 , piece_id=VSQZS3BTZ7LGMGM2WLM6DULGUZV2BTEBM4HLR2723XR6JJ6PFVQA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.122514905 (157h16m47.081612149s) [noise=true , address=104.36.82.9:4025 , piece_id=H4OZCUN6UDJSKE2MJGEB6GMW2LBHZXMVYLDEBLBCODYBMTJZKHHQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.135690810 (157h16m47.094788048s) [noise=true , address=77.90.31.17:4800 , piece_id=5MGULLJGLQMCLGPQJYBTK47S2YUP6Y7JEMIGHQGLCE47NV6P4DXA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.151122173 (157h16m47.110219411s) [noise=true , address=104.36.82.60:4343 , piece_id=SC6OU62UCKBCEOAXNAMWFUGXVMH6JSCBCAMHOFG7LXRKC2LX7ZSA, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.155034878 (157h16m47.114132123s) [noise=true , address=104.36.82.44:4903 , piece_id=2DE45ASYKH4VTNDSKG3EMKG2OBSZSJMUMQSVP4KOVHL4EZMF54MQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204146540 (157h16m47.163243781s) [noise=true , address=79.127.220.101:4066 , piece_id=HATVL7JTLZ3K4E2SJAG4BC2YSRXED5W5NBMWUMOC5UBCF7VGV32A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: <nil>
Aug 15 06:42:25.204185523 (157h16m47.16328277s) [seg_pos={0 0}, upload=163827]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:42:25.204598744 (157h16m47.163695984s) [noise=true , address=104.36.82.34:4569 , piece_id=CUH3CVLDOTPKETR42MKO2DR732UAWOZNZI3XSGNU4CXMEZPJQTQQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123TR9uQHCJtpJnTVzkX3FFTJLVpKBF92Hz423gQB783nc3hU2e): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204696529 (157h16m47.163793768s) [noise=true , address=79.127.201.215:4352 , piece_id=QCFVLQDAKLYA7DQWEIME24CVKR66L6HGTLTIJSRIERKIRYGVYVGQ, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204708094 (157h16m47.163805334s) [noise=true , address=79.127.220.98:4414 , piece_id=ATEI7FL2ZUAW567YWPNW2FJSESUAI7SD7FVQ57DCXZJTLC4YOX6Q, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:42:25.204765477 (157h16m47.163862714s) [noise=true , address=66.23.193.175:4557 , piece_id=ZORPOSZVDXMAVQABL6JFT7NHVIJZXMGFDXBTQP3VQ7YM327EL24A, seg_pos={0 0}, upload=163827]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cDv8DE1XPpVxR5wv8FJqXmT95z478tg85wcwTcoLmob5xKsdU): protocol: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56904->66.23.193.175:4557: use of closed network connection
Aug 15 06:42:25.204786343 (157h16m47.163883583s) [seg_pos={0 0}, upload=163827]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:42:25.204871558 (157h16m47.163968806s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:42:25.204876466 (157h16m47.163973717s) [upload=163827]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:42:25.515807697 (157h16m47.474904943s) [upload=163827]: Done uploading segments...
Aug 15 06:42:25.515828076 (157h16m47.474925314s) [upload=163827]: Upload finished. err: <nil>
Duration: 1.962107087s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..........X..............X....................XX...........] duration:
832.721559ms
FAIL (2025-08-15 06:41:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.783756ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..........X..............X....................XX..........] duration:
893.249075ms
FAIL (2025-08-15 06:41:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 893.27107ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X.....X...................X.X.........X] duration:
1.753422981s
FAIL (2025-08-15 06:41:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:41:29.427559558 (157h15m51.386656804s) [upload=163806]: Starting upload
Aug 15 06:41:29.427609375 (157h15m51.386706621s) [upload=163806]: Done starting upload
Aug 15 06:41:29.427727293 (157h15m51.386824558s) [upload=163806]: Uploading segments...
Aug 15 06:41:29.427989478 (157h15m51.387086722s) [upload=163806]: Got next segment. Inline: false
Aug 15 06:41:29.428030127 (157h15m51.387127373s) [upload=163806]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:41:29.428037405 (157h15m51.387134651s) [upload=163806]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:41:29.627167092 (157h15m51.586264338s) [seg_pos={0 0}, upload=163806]: Begin upload segment...
Aug 15 06:41:29.627229187 (157h15m51.586326418s) [seg_pos={0 0}, upload=163806]: Done begin upload segment.
Aug 15 06:41:29.627254667 (157h15m51.586351916s) [noise=true , address=104.36.82.9:4025 , piece_id=YZEHBDI7PX7V43ARZLUOTHK4XBD5MZYX5HFNXFXKACQZDTNILSCA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.627296678 (157h15m51.58639393s) [noise=true , address=104.36.82.38:4713 , piece_id=X3UEZCDXSTXAEJTK4OFJLVPCRVFAMDS7HXZKN4MPD2STMUAUB5LQ, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.627737450 (157h15m51.586834699s) [noise=true , address=66.23.193.175:4555 , piece_id=I4AXQAWVV64H73IAZ3NMTM23GBNBKMKOMPNKGSYTSXJ46OZVYP5Q, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.628052871 (157h15m51.587150118s) [noise=true , address=104.36.82.5:4859 , piece_id=2PL3GFMZHWPRXJU6KJZDF7LGTIEZ6MHKH6QJ2FM7XYFELXWZLRJA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.628538391 (157h15m51.587635672s) [noise=true , address=104.36.82.60:4353 , piece_id=AXECMEA25YMHSSSEJT43AK7OC2777FQZHMOLAWJRUIR4LHPMEHYQ, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.629118961 (157h15m51.588216212s) [noise=true , address=79.127.201.215:4359 , piece_id=FF5AR3JH52XHCQMQVCCR6KY3UD3KP2YEMIUST7JGLIUTLMVIMQFA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.629407277 (157h15m51.588504524s) [noise=true , address=104.36.82.34:4562 , piece_id=AORP66XZFWGQ77J6SW4TUXCWH5XKKCVHIOP3TMIUZ6H3IRUPM2GA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.629690399 (157h15m51.588787649s) [noise=true , address=104.36.82.39:4729 , piece_id=YZ25YXKI3LYKXFA36IJWJYKLGLFP7WM3HL2DE5C6GUFXQPUUA3RA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.629969243 (157h15m51.589066492s) [noise=true , address=104.36.82.59:4304 , piece_id=D6YHSW7GCD4QKCC4KVYCWVJKGDALIIUKC6V3ICZSJ2QVB6X7MJUA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.630239188 (157h15m51.589336438s) [noise=true , address=104.36.82.8:4988 , piece_id=KW2HQLGQYXMZBJQ4LLOVE2HIMB4IOYK3MCLKDUN5K553I7NW4GUQ, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.630316094 (157h15m51.589413342s) [noise=true , address=77.90.31.18:4814 , piece_id=6CEQWTQLPBUL6V6GLXA6ZVIWISCPDJ75KLUGNSQS5QCAEUOYXGCA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.631021597 (157h15m51.590118851s) [noise=true , address=104.36.82.51:4056 , piece_id=YNJEM6C535CC5ICP7A7VVJWU5U4FFN7JI6CIPQKGGEDNEOQFKAVA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.632547125 (157h15m51.591644373s) [noise=true , address=104.36.82.23:4460 , piece_id=7M37S72GTC47522QFZLYKVTIK423QIPUPZJQ5BSSDW4XWHKI62KA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.633254295 (157h15m51.592351546s) [noise=true , address=77.90.31.12:4605 , piece_id=5WQV6EXOM575Y4RS5E2VKXP5PQZZZSTL3NPD32VFMWO6GCJHV5MQ, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.634030069 (157h15m51.593127324s) [noise=true , address=77.90.31.17:4803 , piece_id=7YDEP2BZKCWG5U5LEEINVI3ERCJU5GVM4EM2CIGE6PBF4WYWHEKQ, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.634186668 (157h15m51.593283916s) [noise=true , address=104.36.82.19:4411 , piece_id=2Z3QDKQ3L3OCVLXT45U6233DCJLLPVNG2C5CAIDXZPVZITMM3NCA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.634511908 (157h15m51.593609159s) [noise=true , address=104.36.82.3:4778 , piece_id=FL5ZETVEAIALWX756PC4DV3SYATDYSH7DTY6SUGQFHJRTZ7NEGKA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:29.635364179 (157h15m51.594461428s) [noise=true , address=104.36.82.17:4341 , piece_id=I26U4KRCHI7CLQFVGOKILKQ7ENQZDQWC3NAZEEVAHPHEJPEGMYOA, seg_pos={0 0}, upload=163806]: Uploading piece...
Aug 15 06:41:30.169778623 (157h15m52.128875873s) [upload=163806]: Next returned nil segment
Aug 15 06:41:30.169801827 (157h15m52.12889909s) [upload=163806]: Waiting for error group managing segments...
Aug 15 06:41:30.346314558 (157h15m52.305411803s) [noise=true , address=77.90.31.18:4814 , piece_id=6CEQWTQLPBUL6V6GLXA6ZVIWISCPDJ75KLUGNSQS5QCAEUOYXGCA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.353167164 (157h15m52.312264396s) [noise=true , address=104.36.82.39:4729 , piece_id=YZ25YXKI3LYKXFA36IJWJYKLGLFP7WM3HL2DE5C6GUFXQPUUA3RA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.365058814 (157h15m52.324156077s) [noise=true , address=104.36.82.19:4411 , piece_id=2Z3QDKQ3L3OCVLXT45U6233DCJLLPVNG2C5CAIDXZPVZITMM3NCA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.371623514 (157h15m52.330720752s) [noise=true , address=104.36.82.34:4562 , piece_id=AORP66XZFWGQ77J6SW4TUXCWH5XKKCVHIOP3TMIUZ6H3IRUPM2GA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.372565644 (157h15m52.331662883s) [noise=true , address=77.90.31.12:4605 , piece_id=5WQV6EXOM575Y4RS5E2VKXP5PQZZZSTL3NPD32VFMWO6GCJHV5MQ, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.373974347 (157h15m52.333071582s) [noise=true , address=104.36.82.60:4353 , piece_id=AXECMEA25YMHSSSEJT43AK7OC2777FQZHMOLAWJRUIR4LHPMEHYQ, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.377984203 (157h15m52.337081449s) [noise=true , address=104.36.82.23:4460 , piece_id=7M37S72GTC47522QFZLYKVTIK423QIPUPZJQ5BSSDW4XWHKI62KA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.390850484 (157h15m52.349947723s) [noise=true , address=104.36.82.5:4859 , piece_id=2PL3GFMZHWPRXJU6KJZDF7LGTIEZ6MHKH6QJ2FM7XYFELXWZLRJA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.398727007 (157h15m52.357824247s) [noise=true , address=104.36.82.59:4304 , piece_id=D6YHSW7GCD4QKCC4KVYCWVJKGDALIIUKC6V3ICZSJ2QVB6X7MJUA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.401577501 (157h15m52.360674736s) [noise=true , address=104.36.82.8:4988 , piece_id=KW2HQLGQYXMZBJQ4LLOVE2HIMB4IOYK3MCLKDUN5K553I7NW4GUQ, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.412087440 (157h15m52.371184679s) [noise=true , address=77.90.31.17:4803 , piece_id=7YDEP2BZKCWG5U5LEEINVI3ERCJU5GVM4EM2CIGE6PBF4WYWHEKQ, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.443345331 (157h15m52.402442572s) [noise=true , address=104.36.82.38:4713 , piece_id=X3UEZCDXSTXAEJTK4OFJLVPCRVFAMDS7HXZKN4MPD2STMUAUB5LQ, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.444438121 (157h15m52.403535353s) [noise=true , address=104.36.82.17:4341 , piece_id=I26U4KRCHI7CLQFVGOKILKQ7ENQZDQWC3NAZEEVAHPHEJPEGMYOA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.446717935 (157h15m52.405815165s) [noise=true , address=104.36.82.3:4778 , piece_id=FL5ZETVEAIALWX756PC4DV3SYATDYSH7DTY6SUGQFHJRTZ7NEGKA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: <nil>
Aug 15 06:41:30.446750066 (157h15m52.405847311s) [seg_pos={0 0}, upload=163806]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:41:30.446885017 (157h15m52.405982261s) [noise=true , address=79.127.201.215:4359 , piece_id=FF5AR3JH52XHCQMQVCCR6KY3UD3KP2YEMIUST7JGLIUTLMVIMQFA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 15 06:41:30.446958770 (157h15m52.406056002s) [noise=true , address=104.36.82.9:4025 , piece_id=YZEHBDI7PX7V43ARZLUOTHK4XBD5MZYX5HFNXFXKACQZDTNILSCA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1244zx11aa7W2RGE7w1qeLfsHLxQ6f8tLJeNcxssa68QywFbX1R): protocol: expected piece hash; context canceled; EOF
Aug 15 06:41:30.447042128 (157h15m52.406139361s) [noise=true , address=104.36.82.51:4056 , piece_id=YNJEM6C535CC5ICP7A7VVJWU5U4FFN7JI6CIPQKGGEDNEOQFKAVA, seg_pos={0 0}, upload=163806]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nY93g6WbZs2rfBYoKtf4Z7xGSr1QwizrBibKjpgKFbTbnVe1c): protocol: expected piece hash; context canceled; EOF
Aug 15 06:41:30.447051701 (157h15m52.406148962s) [noise=true , address=66.23.193.175:4555 , piece_id=I4AXQAWVV64H73IAZ3NMTM23GBNBKMKOMPNKGSYTSXJ46OZVYP5Q, seg_pos={0 0}, upload=163806]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 139.59.144.22:34096->66.23.193.175:4555: use of closed network connection; write tcp 139.59.144.22:34096->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34096->66.23.193.175:4555: use of closed network connection
Aug 15 06:41:30.447081703 (157h15m52.406178952s) [seg_pos={0 0}, upload=163806]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:41:30.447167670 (157h15m52.406264903s) [upload=163806]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:41:30.447173394 (157h15m52.40627073s) [upload=163806]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:41:30.601184322 (157h15m52.560281585s) [upload=163806]: Done uploading segments...
Aug 15 06:41:30.601239114 (157h15m52.560336345s) [upload=163806]: Upload finished. err: <nil>
Duration: 1.753518977s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......................X.....X...................X.X.........] duration:
2.418517731s
FAIL (2025-08-15 06:41:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.418716901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.....X...................X.X........] duration:
2.333169467s
FAIL (2025-08-15 06:40:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.333209031s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..........X..............X....................XX.........] duration:
1.074025872s
FAIL (2025-08-15 06:40:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.074070909s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X.....X...................X.X.......] duration:
2.496778521s
FAIL (2025-08-15 06:40:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.496838642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X..........X..............X....................XX........] duration:
816.197372ms
FAIL (2025-08-15 06:39:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 816.230149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.....X...................X.X......] duration:
2.366403931s
FAIL (2025-08-15 06:39:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.366445364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X..........X..............X....................XX.......] duration:
834.333984ms
FAIL (2025-08-15 06:39:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.393913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.....X...................X.X.....] duration:
2.308354313s
FAIL (2025-08-15 06:38:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.308382924s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X..........X..............X....................XX......] duration:
824.201433ms
FAIL (2025-08-15 06:38:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.23742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|