Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X........................................X............X..] duration:
1.116154885s
FAIL (2025-08-11 01:10:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 01:09:11.437673399 (55h43m33.39677064s) [upload=58083]: Starting upload Aug 11 01:09:11.437751341 (55h43m33.396848591s) [upload=58083]: Done starting upload Aug 11 01:09:11.437840704 (55h43m33.396937939s) [upload=58083]: Uploading segments... Aug 11 01:09:11.437888855 (55h43m33.396986109s) [upload=58083]: Got next segment. Inline: true Aug 11 01:09:11.437894603 (55h43m33.396991849s) [upload=58083]: Waiting for error group managing segments... Aug 11 01:09:11.437964152 (55h43m33.397061398s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 01:09:11.437971181 (55h43m33.397068431s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 01:09:11.437977830 (55h43m33.397075076s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 01:09:11.526067850 (55h43m33.485165107s) [upload=58083]: Done uploading segments... Aug 11 01:09:11.526107247 (55h43m33.485204501s) [upload=58083]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.116181601s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.........................................X....] duration:
2.505709635s
FAIL (2025-08-11 01:09:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3d57d28506bb1e1e01eac9d757a9564084ea7931c90e921304e002a151bea3d1 != before 8cfd3e1b1f3396b528e40ca8e6b9d2a957c37f77779909f1a914f10fa7f1d498
======LOGS======
Aug 11 01:06:22.530435136 (55h40m44.489532408s) [upload=58033]: Starting upload
Aug 11 01:06:22.530540389 (55h40m44.489637625s) [upload=58033]: Done starting upload
Aug 11 01:06:22.530790861 (55h40m44.489888144s) [upload=58033]: Uploading segments...
Aug 11 01:06:22.531130451 (55h40m44.490227696s) [upload=58033]: Got next segment. Inline: false
Aug 11 01:06:22.531196723 (55h40m44.490293968s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:06:22.531203018 (55h40m44.490300264s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 01:06:22.727339972 (55h40m44.68643722s) [seg_pos={0 0}, upload=58033]: Begin upload segment...
Aug 11 01:06:22.727405030 (55h40m44.686502266s) [seg_pos={0 0}, upload=58033]: Done begin upload segment.
Aug 11 01:06:22.727438629 (55h40m44.686535876s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.727468830 (55h40m44.686566086s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728026671 (55h40m44.687123926s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728074166 (55h40m44.687171422s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728387925 (55h40m44.687485173s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728449910 (55h40m44.687547156s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728702736 (55h40m44.687799988s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728813770 (55h40m44.687911018s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729016188 (55h40m44.688113443s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729139301 (55h40m44.688236549s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729296827 (55h40m44.688394075s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729532286 (55h40m44.688629537s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729542896 (55h40m44.688640145s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729776729 (55h40m44.688873975s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729935884 (55h40m44.68903313s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.730298918 (55h40m44.689396172s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.734306881 (55h40m44.693404135s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.736074695 (55h40m44.695171932s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:23.295511891 (55h40m45.254609143s) [upload=58033]: Next returned nil segment
Aug 11 01:06:23.295536026 (55h40m45.254633287s) [upload=58033]: Waiting for error group managing segments...
Aug 11 01:06:23.454813042 (55h40m45.413910288s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.456654912 (55h40m45.415752161s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.457237173 (55h40m45.416334423s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.460850230 (55h40m45.419947479s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489385221 (55h40m45.448482467s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489977723 (55h40m45.449074969s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490304703 (55h40m45.449401944s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490462861 (55h40m45.449560096s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490918078 (55h40m45.450015318s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.495887139 (55h40m45.454984396s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.526732233 (55h40m45.485829486s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.588083195 (55h40m45.547180433s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.970486915 (55h40m45.929584228s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976113937 (55h40m45.935211187s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976167798 (55h40m45.935265044s) [seg_pos={0 0}, upload=58033]: Segment reached optimal threshold of 14 pieces.
Aug 11 01:06:23.976392447 (55h40m45.93548969s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976431019 (55h40m45.935528268s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gjYLb4S829ccDU1jgsu7JxwCyJ27U8LdombmqZQhZLygTJLsZ): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976604915 (55h40m45.935702166s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976668822 (55h40m45.935766068s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection
Aug 11 01:06:23.976716608 (55h40m45.935813847s) [seg_pos={0 0}, upload=58033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 01:06:23.976845069 (55h40m45.935942316s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 01:06:23.976851170 (55h40m45.935948416s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:06:24.124236866 (55h40m46.083334195s) [upload=58033]: Done uploading segments...
Aug 11 01:06:24.124257821 (55h40m46.08335506s) [upload=58033]: Upload finished. err: <nil>
Duration: 2.505738036s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X........................................X............X.] duration:
1.045041683s
FAIL (2025-08-11 01:09:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 01:09:11.437673399 (55h43m33.39677064s) [upload=58083]: Starting upload Aug 11 01:09:11.437751341 (55h43m33.396848591s) [upload=58083]: Done starting upload Aug 11 01:09:11.437840704 (55h43m33.396937939s) [upload=58083]: Uploading segments... Aug 11 01:09:11.437888855 (55h43m33.396986109s) [upload=58083]: Got next segment. Inline: true Aug 11 01:09:11.437894603 (55h43m33.396991849s) [upload=58083]: Waiting for error group managing segments... Aug 11 01:09:11.437964152 (55h43m33.397061398s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 01:09:11.437971181 (55h43m33.397068431s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 01:09:11.437977830 (55h43m33.397075076s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 01:09:11.526067850 (55h43m33.485165107s) [upload=58083]: Done uploading segments... Aug 11 01:09:11.526107247 (55h43m33.485204501s) [upload=58083]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.045082514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X........................................X............X] duration:
357.090442ms
FAIL (2025-08-11 01:09:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 01:09:11.437673399 (55h43m33.39677064s) [upload=58083]: Starting upload Aug 11 01:09:11.437751341 (55h43m33.396848591s) [upload=58083]: Done starting upload Aug 11 01:09:11.437840704 (55h43m33.396937939s) [upload=58083]: Uploading segments... Aug 11 01:09:11.437888855 (55h43m33.396986109s) [upload=58083]: Got next segment. Inline: true Aug 11 01:09:11.437894603 (55h43m33.396991849s) [upload=58083]: Waiting for error group managing segments... Aug 11 01:09:11.437964152 (55h43m33.397061398s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 01:09:11.437971181 (55h43m33.397068431s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 01:09:11.437977830 (55h43m33.397075076s) [upload=58083]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 01:09:11.526067850 (55h43m33.485165107s) [upload=58083]: Done uploading segments... Aug 11 01:09:11.526107247 (55h43m33.485204501s) [upload=58083]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.133444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.........................................X...] duration:
2.670250724s
FAIL (2025-08-11 01:08:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3d57d28506bb1e1e01eac9d757a9564084ea7931c90e921304e002a151bea3d1 != before 8cfd3e1b1f3396b528e40ca8e6b9d2a957c37f77779909f1a914f10fa7f1d498
======LOGS======
Aug 11 01:06:22.530435136 (55h40m44.489532408s) [upload=58033]: Starting upload
Aug 11 01:06:22.530540389 (55h40m44.489637625s) [upload=58033]: Done starting upload
Aug 11 01:06:22.530790861 (55h40m44.489888144s) [upload=58033]: Uploading segments...
Aug 11 01:06:22.531130451 (55h40m44.490227696s) [upload=58033]: Got next segment. Inline: false
Aug 11 01:06:22.531196723 (55h40m44.490293968s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:06:22.531203018 (55h40m44.490300264s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 01:06:22.727339972 (55h40m44.68643722s) [seg_pos={0 0}, upload=58033]: Begin upload segment...
Aug 11 01:06:22.727405030 (55h40m44.686502266s) [seg_pos={0 0}, upload=58033]: Done begin upload segment.
Aug 11 01:06:22.727438629 (55h40m44.686535876s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.727468830 (55h40m44.686566086s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728026671 (55h40m44.687123926s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728074166 (55h40m44.687171422s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728387925 (55h40m44.687485173s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728449910 (55h40m44.687547156s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728702736 (55h40m44.687799988s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728813770 (55h40m44.687911018s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729016188 (55h40m44.688113443s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729139301 (55h40m44.688236549s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729296827 (55h40m44.688394075s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729532286 (55h40m44.688629537s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729542896 (55h40m44.688640145s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729776729 (55h40m44.688873975s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729935884 (55h40m44.68903313s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.730298918 (55h40m44.689396172s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.734306881 (55h40m44.693404135s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.736074695 (55h40m44.695171932s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:23.295511891 (55h40m45.254609143s) [upload=58033]: Next returned nil segment
Aug 11 01:06:23.295536026 (55h40m45.254633287s) [upload=58033]: Waiting for error group managing segments...
Aug 11 01:06:23.454813042 (55h40m45.413910288s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.456654912 (55h40m45.415752161s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.457237173 (55h40m45.416334423s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.460850230 (55h40m45.419947479s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489385221 (55h40m45.448482467s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489977723 (55h40m45.449074969s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490304703 (55h40m45.449401944s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490462861 (55h40m45.449560096s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490918078 (55h40m45.450015318s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.495887139 (55h40m45.454984396s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.526732233 (55h40m45.485829486s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.588083195 (55h40m45.547180433s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.970486915 (55h40m45.929584228s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976113937 (55h40m45.935211187s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976167798 (55h40m45.935265044s) [seg_pos={0 0}, upload=58033]: Segment reached optimal threshold of 14 pieces.
Aug 11 01:06:23.976392447 (55h40m45.93548969s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976431019 (55h40m45.935528268s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gjYLb4S829ccDU1jgsu7JxwCyJ27U8LdombmqZQhZLygTJLsZ): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976604915 (55h40m45.935702166s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976668822 (55h40m45.935766068s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection
Aug 11 01:06:23.976716608 (55h40m45.935813847s) [seg_pos={0 0}, upload=58033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 01:06:23.976845069 (55h40m45.935942316s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 01:06:23.976851170 (55h40m45.935948416s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:06:24.124236866 (55h40m46.083334195s) [upload=58033]: Done uploading segments...
Aug 11 01:06:24.124257821 (55h40m46.08335506s) [upload=58033]: Upload finished. err: <nil>
Duration: 2.670289974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X........................................X............] duration:
899.188275ms
FAIL (2025-08-11 01:08:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 899.242871ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.........................................X..] duration:
2.410627714s
FAIL (2025-08-11 01:08:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3d57d28506bb1e1e01eac9d757a9564084ea7931c90e921304e002a151bea3d1 != before 8cfd3e1b1f3396b528e40ca8e6b9d2a957c37f77779909f1a914f10fa7f1d498
======LOGS======
Aug 11 01:06:22.530435136 (55h40m44.489532408s) [upload=58033]: Starting upload
Aug 11 01:06:22.530540389 (55h40m44.489637625s) [upload=58033]: Done starting upload
Aug 11 01:06:22.530790861 (55h40m44.489888144s) [upload=58033]: Uploading segments...
Aug 11 01:06:22.531130451 (55h40m44.490227696s) [upload=58033]: Got next segment. Inline: false
Aug 11 01:06:22.531196723 (55h40m44.490293968s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:06:22.531203018 (55h40m44.490300264s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 01:06:22.727339972 (55h40m44.68643722s) [seg_pos={0 0}, upload=58033]: Begin upload segment...
Aug 11 01:06:22.727405030 (55h40m44.686502266s) [seg_pos={0 0}, upload=58033]: Done begin upload segment.
Aug 11 01:06:22.727438629 (55h40m44.686535876s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.727468830 (55h40m44.686566086s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728026671 (55h40m44.687123926s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728074166 (55h40m44.687171422s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728387925 (55h40m44.687485173s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728449910 (55h40m44.687547156s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728702736 (55h40m44.687799988s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728813770 (55h40m44.687911018s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729016188 (55h40m44.688113443s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729139301 (55h40m44.688236549s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729296827 (55h40m44.688394075s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729532286 (55h40m44.688629537s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729542896 (55h40m44.688640145s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729776729 (55h40m44.688873975s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729935884 (55h40m44.68903313s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.730298918 (55h40m44.689396172s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.734306881 (55h40m44.693404135s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.736074695 (55h40m44.695171932s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:23.295511891 (55h40m45.254609143s) [upload=58033]: Next returned nil segment
Aug 11 01:06:23.295536026 (55h40m45.254633287s) [upload=58033]: Waiting for error group managing segments...
Aug 11 01:06:23.454813042 (55h40m45.413910288s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.456654912 (55h40m45.415752161s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.457237173 (55h40m45.416334423s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.460850230 (55h40m45.419947479s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489385221 (55h40m45.448482467s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489977723 (55h40m45.449074969s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490304703 (55h40m45.449401944s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490462861 (55h40m45.449560096s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490918078 (55h40m45.450015318s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.495887139 (55h40m45.454984396s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.526732233 (55h40m45.485829486s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.588083195 (55h40m45.547180433s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.970486915 (55h40m45.929584228s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976113937 (55h40m45.935211187s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976167798 (55h40m45.935265044s) [seg_pos={0 0}, upload=58033]: Segment reached optimal threshold of 14 pieces.
Aug 11 01:06:23.976392447 (55h40m45.93548969s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976431019 (55h40m45.935528268s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gjYLb4S829ccDU1jgsu7JxwCyJ27U8LdombmqZQhZLygTJLsZ): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976604915 (55h40m45.935702166s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976668822 (55h40m45.935766068s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection
Aug 11 01:06:23.976716608 (55h40m45.935813847s) [seg_pos={0 0}, upload=58033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 01:06:23.976845069 (55h40m45.935942316s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 01:06:23.976851170 (55h40m45.935948416s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:06:24.124236866 (55h40m46.083334195s) [upload=58033]: Done uploading segments...
Aug 11 01:06:24.124257821 (55h40m46.08335506s) [upload=58033]: Upload finished. err: <nil>
Duration: 2.410741127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X........................................X...........] duration:
1.043378114s
FAIL (2025-08-11 01:07:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 1.043502584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.........................................X.] duration:
2.493338045s
FAIL (2025-08-11 01:06:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3d57d28506bb1e1e01eac9d757a9564084ea7931c90e921304e002a151bea3d1 != before 8cfd3e1b1f3396b528e40ca8e6b9d2a957c37f77779909f1a914f10fa7f1d498
======LOGS======
Aug 11 01:06:22.530435136 (55h40m44.489532408s) [upload=58033]: Starting upload
Aug 11 01:06:22.530540389 (55h40m44.489637625s) [upload=58033]: Done starting upload
Aug 11 01:06:22.530790861 (55h40m44.489888144s) [upload=58033]: Uploading segments...
Aug 11 01:06:22.531130451 (55h40m44.490227696s) [upload=58033]: Got next segment. Inline: false
Aug 11 01:06:22.531196723 (55h40m44.490293968s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:06:22.531203018 (55h40m44.490300264s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 01:06:22.727339972 (55h40m44.68643722s) [seg_pos={0 0}, upload=58033]: Begin upload segment...
Aug 11 01:06:22.727405030 (55h40m44.686502266s) [seg_pos={0 0}, upload=58033]: Done begin upload segment.
Aug 11 01:06:22.727438629 (55h40m44.686535876s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.727468830 (55h40m44.686566086s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728026671 (55h40m44.687123926s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728074166 (55h40m44.687171422s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728387925 (55h40m44.687485173s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728449910 (55h40m44.687547156s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728702736 (55h40m44.687799988s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728813770 (55h40m44.687911018s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729016188 (55h40m44.688113443s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729139301 (55h40m44.688236549s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729296827 (55h40m44.688394075s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729532286 (55h40m44.688629537s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729542896 (55h40m44.688640145s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729776729 (55h40m44.688873975s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729935884 (55h40m44.68903313s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.730298918 (55h40m44.689396172s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.734306881 (55h40m44.693404135s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.736074695 (55h40m44.695171932s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:23.295511891 (55h40m45.254609143s) [upload=58033]: Next returned nil segment
Aug 11 01:06:23.295536026 (55h40m45.254633287s) [upload=58033]: Waiting for error group managing segments...
Aug 11 01:06:23.454813042 (55h40m45.413910288s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.456654912 (55h40m45.415752161s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.457237173 (55h40m45.416334423s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.460850230 (55h40m45.419947479s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489385221 (55h40m45.448482467s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489977723 (55h40m45.449074969s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490304703 (55h40m45.449401944s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490462861 (55h40m45.449560096s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490918078 (55h40m45.450015318s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.495887139 (55h40m45.454984396s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.526732233 (55h40m45.485829486s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.588083195 (55h40m45.547180433s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.970486915 (55h40m45.929584228s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976113937 (55h40m45.935211187s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976167798 (55h40m45.935265044s) [seg_pos={0 0}, upload=58033]: Segment reached optimal threshold of 14 pieces.
Aug 11 01:06:23.976392447 (55h40m45.93548969s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976431019 (55h40m45.935528268s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gjYLb4S829ccDU1jgsu7JxwCyJ27U8LdombmqZQhZLygTJLsZ): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976604915 (55h40m45.935702166s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976668822 (55h40m45.935766068s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection
Aug 11 01:06:23.976716608 (55h40m45.935813847s) [seg_pos={0 0}, upload=58033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 01:06:23.976845069 (55h40m45.935942316s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 01:06:23.976851170 (55h40m45.935948416s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:06:24.124236866 (55h40m46.083334195s) [upload=58033]: Done uploading segments...
Aug 11 01:06:24.124257821 (55h40m46.08335506s) [upload=58033]: Upload finished. err: <nil>
Duration: 2.493372572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X........................................X..........] duration:
817.507703ms
FAIL (2025-08-11 01:06:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 817.537689ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.........................................X] duration:
2.806778239s
FAIL (2025-08-11 01:06:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3d57d28506bb1e1e01eac9d757a9564084ea7931c90e921304e002a151bea3d1 != before 8cfd3e1b1f3396b528e40ca8e6b9d2a957c37f77779909f1a914f10fa7f1d498
======LOGS======
Aug 11 01:06:22.530435136 (55h40m44.489532408s) [upload=58033]: Starting upload
Aug 11 01:06:22.530540389 (55h40m44.489637625s) [upload=58033]: Done starting upload
Aug 11 01:06:22.530790861 (55h40m44.489888144s) [upload=58033]: Uploading segments...
Aug 11 01:06:22.531130451 (55h40m44.490227696s) [upload=58033]: Got next segment. Inline: false
Aug 11 01:06:22.531196723 (55h40m44.490293968s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 01:06:22.531203018 (55h40m44.490300264s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 01:06:22.727339972 (55h40m44.68643722s) [seg_pos={0 0}, upload=58033]: Begin upload segment...
Aug 11 01:06:22.727405030 (55h40m44.686502266s) [seg_pos={0 0}, upload=58033]: Done begin upload segment.
Aug 11 01:06:22.727438629 (55h40m44.686535876s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.727468830 (55h40m44.686566086s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728026671 (55h40m44.687123926s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728074166 (55h40m44.687171422s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728387925 (55h40m44.687485173s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728449910 (55h40m44.687547156s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728702736 (55h40m44.687799988s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.728813770 (55h40m44.687911018s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729016188 (55h40m44.688113443s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729139301 (55h40m44.688236549s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729296827 (55h40m44.688394075s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729532286 (55h40m44.688629537s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729542896 (55h40m44.688640145s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729776729 (55h40m44.688873975s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.729935884 (55h40m44.68903313s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.730298918 (55h40m44.689396172s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.734306881 (55h40m44.693404135s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:22.736074695 (55h40m44.695171932s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Uploading piece...
Aug 11 01:06:23.295511891 (55h40m45.254609143s) [upload=58033]: Next returned nil segment
Aug 11 01:06:23.295536026 (55h40m45.254633287s) [upload=58033]: Waiting for error group managing segments...
Aug 11 01:06:23.454813042 (55h40m45.413910288s) [noise=true , address=104.36.82.62:4413 , piece_id=W5GUH3FHULSWTKEDFKRNSQK62RGW4GUKQP7LS3RBMKT7SFPPCMPQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.456654912 (55h40m45.415752161s) [noise=true , address=104.36.82.2:4733 , piece_id=ZGZGJZT6ITSLK2ZI6Z64BYT2MVPDJTVLA4E3WAUB5UAKUAYX5B7A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.457237173 (55h40m45.416334423s) [noise=true , address=104.36.82.22:4537 , piece_id=LXYW6WSN22UFBCUNEQV2MAVWJPG3ENRGAGPBWB4XZKYG7KDKSZTQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.460850230 (55h40m45.419947479s) [noise=true , address=104.36.82.9:4026 , piece_id=F5C5EK4DY44FJO2QFM6KD7NWUWG462H2SIVZLZM2ICV56CRR4HVQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489385221 (55h40m45.448482467s) [noise=true , address=104.36.82.35:4583 , piece_id=4L2ATJWNFA6RPUVL4V7FJPPQIPLXTTVH2TX5HG2HJJN2AY4P6LTA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.489977723 (55h40m45.449074969s) [noise=true , address=104.36.82.16:4313 , piece_id=KN4HROGH5KE447JYK4H5JLF6QE2XVSXBWUHBT5KQQSGQA7MCRTGQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490304703 (55h40m45.449401944s) [noise=true , address=104.36.82.34:4549 , piece_id=ETX6SWYYAKMXJQ7G7PLEJY44NOYJW7WBXXUDSTTWHFX6JEVH23SQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490462861 (55h40m45.449560096s) [noise=true , address=104.36.82.44:4869 , piece_id=4I5UZUIPDCKGP6L3PRPD3DPNOS4AFWBNFTRTBLEQXURZX5MTN3WA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.490918078 (55h40m45.450015318s) [noise=true , address=104.36.82.61:4402 , piece_id=OOXI4AUCTQBGPI5OY4LO2OBUR6SJ2252GUVGD34Y4FO5QUOV5FAA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.495887139 (55h40m45.454984396s) [noise=true , address=104.36.82.8:4995 , piece_id=UYRCYGODUBMWLM7CLEESLKWDNA5RNKGFECRERCXWSQ4XY3QBMIGA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.526732233 (55h40m45.485829486s) [noise=true , address=104.36.82.60:4366 , piece_id=FGZFQRU3P3BIDJ5JRK5QU7UVSEW4NYTOJ2PSRBDOUODCJM3CLBHQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.588083195 (55h40m45.547180433s) [noise=true , address=104.36.82.60:4372 , piece_id=WWPFN542CNPE3M2BMPPB7CTCAH3Z6DO77WUTTCLHPB2LYLSPQSXQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.970486915 (55h40m45.929584228s) [noise=true , address=64.49.13.27:4964 , piece_id=T66N2A2ZVHUKGZFBLLIKZFMMKASRMEL765R3XNZWYO3ODMC6PFYA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976113937 (55h40m45.935211187s) [noise=true , address=64.49.13.26:4946 , piece_id=3WYYIDCIFWM7XHL5SBAKB7KGQUBB5D2QXXMPJFTIUMQ3CVVFJNLA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: <nil>
Aug 11 01:06:23.976167798 (55h40m45.935265044s) [seg_pos={0 0}, upload=58033]: Segment reached optimal threshold of 14 pieces.
Aug 11 01:06:23.976392447 (55h40m45.93548969s) [noise=true , address=64.49.13.169:4707 , piece_id=IDNPDYMI4I4ECGBOODBIB2AC7XFIVYV4BBR75MD7IRMBXKWXAR3A, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976431019 (55h40m45.935528268s) [noise=true , address=79.127.205.245:4237 , piece_id=64I3MGKPWZKSPZHGXP7QV52FK4NW5J45FIZHJYWDESAQYNE3Y5DQ, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gjYLb4S829ccDU1jgsu7JxwCyJ27U8LdombmqZQhZLygTJLsZ): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976604915 (55h40m45.935702166s) [noise=true , address=64.49.13.169:4711 , piece_id=RJWLSGT47AZQMTD4UUSMRX3QGEQDVCN2YXLASQVDPC7UHPY7YDVA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 01:06:23.976668822 (55h40m45.935766068s) [noise=true , address=104.36.82.5:4871 , piece_id=2SIQLFPWI4WJQ4WJYZBHBRSZGEYLXTLSNOQYB7LJE7Q7KGLVKAUA, seg_pos={0 0}, upload=58033]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NEVGFZtdgMqREnYBPuBbYqwGRxExenRwncwCBLDFhuwdFyWdb): protocol: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48324->104.36.82.5:4871: use of closed network connection
Aug 11 01:06:23.976716608 (55h40m45.935813847s) [seg_pos={0 0}, upload=58033]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 01:06:23.976845069 (55h40m45.935942316s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 01:06:23.976851170 (55h40m45.935948416s) [upload=58033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 01:06:24.124236866 (55h40m46.083334195s) [upload=58033]: Done uploading segments...
Aug 11 01:06:24.124257821 (55h40m46.08335506s) [upload=58033]: Upload finished. err: <nil>
Duration: 2.806819229s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.438129986s
FAIL (2025-08-11 01:06:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.438168443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X........................................X.........] duration:
1.017113136s
FAIL (2025-08-11 01:05:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 1.017137776s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X........................................X........] duration:
917.085251ms
FAIL (2025-08-11 01:05:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 917.129454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.561313143s
FAIL (2025-08-11 01:05:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.561411226s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.828679733s
FAIL (2025-08-11 01:04:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.828716523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................................X.......] duration:
853.280408ms
FAIL (2025-08-11 01:04:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 853.316166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.608628761s
FAIL (2025-08-11 01:03:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.608653657s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X........................................X......] duration:
1.01240116s
FAIL (2025-08-11 01:03:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 1.012433484s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.710170831s
FAIL (2025-08-11 01:03:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.710261256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.553294627s
FAIL (2025-08-11 01:02:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.553326011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................................X.....] duration:
856.443435ms
FAIL (2025-08-11 01:02:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 856.474188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.542298486s
FAIL (2025-08-11 01:01:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.542365966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................................X....] duration:
980.513136ms
FAIL (2025-08-11 01:01:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 980.556741ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................................X...] duration:
940.472645ms
FAIL (2025-08-11 01:01:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 940.500752ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
3.03667152s
FAIL (2025-08-11 01:01:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.036708332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........................................X..] duration:
958.165816ms
FAIL (2025-08-11 01:00:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 958.207323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.747782484s
FAIL (2025-08-11 00:59:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.747817874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................................X.] duration:
874.256159ms
FAIL (2025-08-11 00:59:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 874.284893ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.610098973s
FAIL (2025-08-11 00:59:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.610125504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................................X] duration:
637.011964ms
FAIL (2025-08-11 00:58:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 00:58:27.480485426 (55h32m49.439582676s) [upload=57898]: Starting upload Aug 11 00:58:27.480565277 (55h32m49.439662533s) [upload=57898]: Done starting upload Aug 11 00:58:27.480661678 (55h32m49.439758924s) [upload=57898]: Uploading segments... Aug 11 00:58:27.480720476 (55h32m49.439817731s) [upload=57898]: Got next segment. Inline: true Aug 11 00:58:27.480726697 (55h32m49.439823953s) [upload=57898]: Waiting for error group managing segments... Aug 11 00:58:27.480780217 (55h32m49.43987747s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:58:27.480785841 (55h32m49.439883092s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 00:58:27.480789758 (55h32m49.439887009s) [upload=57898]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 00:58:27.631770941 (55h32m49.590868193s) [upload=57898]: Done uploading segments... Aug 11 00:58:27.631811315 (55h32m49.590908561s) [upload=57898]: Upload finished. err: <nil>
Duration: 637.043897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.647283632s
FAIL (2025-08-11 00:58:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.64731166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
893.205133ms
FAIL (2025-08-11 00:58:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 893.234417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.788657104s
FAIL (2025-08-11 00:57:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.788699499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
969.937189ms
FAIL (2025-08-11 00:57:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 969.970743ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.790435315s
FAIL (2025-08-11 00:57:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.790464754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
3.038073753s
FAIL (2025-08-11 00:57:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.038101697s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
885.038787ms
FAIL (2025-08-11 00:56:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 885.070242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.687858571s
FAIL (2025-08-11 00:56:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.687897583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
845.395098ms
FAIL (2025-08-11 00:55:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 845.424338ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
3.056514423s
FAIL (2025-08-11 00:55:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.05655833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.882486121s
FAIL (2025-08-11 00:55:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.882530235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.87547182s
FAIL (2025-08-11 00:54:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.875502824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
982.881457ms
FAIL (2025-08-11 00:54:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 982.911503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
881.037647ms
FAIL (2025-08-11 00:54:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 881.070064ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.384383632s
FAIL (2025-08-11 00:53:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.384428594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
829.901436ms
FAIL (2025-08-11 00:53:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 829.933714ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
855.165938ms
FAIL (2025-08-11 00:52:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 855.268818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
3.168405347s
FAIL (2025-08-11 00:52:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 00:37:07.441040452 (55h11m29.40013771s) [upload=57531]: Starting upload Aug 11 00:37:07.441118499 (55h11m29.400215751s) [upload=57531]: Done starting upload Aug 11 00:37:07.441240638 (55h11m29.400337909s) [upload=57531]: Uploading segments... Aug 11 00:37:07.441482549 (55h11m29.400579784s) [upload=57531]: Got next segment. Inline: false Aug 11 00:37:07.441531528 (55h11m29.400628772s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 00:37:07.441537152 (55h11m29.400634398s) [upload=57531]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 00:37:07.530003268 (55h11m29.489100529s) [upload=57531]: Next segment err: metaclient: Too Many Requests Aug 11 00:37:07.530029445 (55h11m29.489126702s) [upload=57531]: Done uploading segments... Aug 11 00:37:07.530049344 (55h11m29.489146591s) [upload=57531]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.168439006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
875.009598ms
FAIL (2025-08-11 00:52:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 00:29:27.365123263 (55h3m49.324220509s) [upload=57394]: Starting upload
Aug 11 00:29:27.365210966 (55h3m49.324308215s) [upload=57394]: Done starting upload
Aug 11 00:29:27.365343062 (55h3m49.3244403s) [upload=57394]: Uploading segments...
Aug 11 00:29:27.365426085 (55h3m49.324523336s) [upload=57394]: Got next segment. Inline: true
Aug 11 00:29:27.365432682 (55h3m49.32452993s) [upload=57394]: Waiting for error group managing segments...
Aug 11 00:29:27.365516755 (55h3m49.324614002s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 00:29:27.365524761 (55h3m49.324622008s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 00:29:27.365528465 (55h3m49.324625711s) [upload=57394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 00:29:27.511102718 (55h3m49.470199968s) [upload=57394]: Done uploading segments...
Aug 11 00:29:27.511127839 (55h3m49.470225088s) [upload=57394]: Upload finished. err: <nil>
Duration: 875.060039ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|