Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.............X..............................] duration:
2.336255923s
FAIL (2025-08-17 05:24:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.336296293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.X........X............................................] duration:
811.729328ms
FAIL (2025-08-17 05:24:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.758586ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.............X.............................] duration:
2.399848829s
FAIL (2025-08-17 05:24:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.399898435s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.X........X...........................................] duration:
892.689874ms
FAIL (2025-08-17 05:23:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 892.781922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.............X............................] duration:
2.500573129s
FAIL (2025-08-17 05:23:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.500671894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.X........X..........................................] duration:
832.348182ms
FAIL (2025-08-17 05:23:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.386823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.............X...........................] duration:
2.389484547s
FAIL (2025-08-17 05:22:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.389543152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.X........X.........................................] duration:
870.449234ms
FAIL (2025-08-17 05:22:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 870.481282ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration:
2.593470753s
FAIL (2025-08-17 05:21:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.593521364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration:
2.509496902s
FAIL (2025-08-17 05:21:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.509530106s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.X........X........................................] duration:
1.010458902s
FAIL (2025-08-17 05:21:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.010500345s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration:
2.374411876s
FAIL (2025-08-17 05:20:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.37444063s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.X........X.......................................] duration:
912.833138ms
FAIL (2025-08-17 05:20:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 912.863878ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.X........X......................................] duration:
971.373428ms
FAIL (2025-08-17 05:20:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 971.409253ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration:
2.36188777s
FAIL (2025-08-17 05:19:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.36198982s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.X........X.....................................] duration:
862.358508ms
FAIL (2025-08-17 05:19:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.393238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration:
2.436454224s
FAIL (2025-08-17 05:19:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.436494315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.X........X....................................] duration:
806.199781ms
FAIL (2025-08-17 05:18:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 806.236669ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration:
2.318448498s
FAIL (2025-08-17 05:18:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.318481378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration:
2.4882827s
FAIL (2025-08-17 05:18:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.488318539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.........................X.............X...................] duration:
2.309201709s
FAIL (2025-08-17 05:17:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.309239994s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.X........X...................................] duration:
817.822914ms
FAIL (2025-08-17 05:17:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.857676ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.........................X.............X..................] duration:
2.364539753s
FAIL (2025-08-17 05:16:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.364569034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.X........X..................................] duration:
907.941234ms
FAIL (2025-08-17 05:16:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.971162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.X........X.................................] duration:
888.747866ms
FAIL (2025-08-17 05:15:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 888.781314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.........................X.............X.................] duration:
2.325366701s
FAIL (2025-08-17 05:15:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.325400275s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.X........X................................] duration:
944.702054ms
FAIL (2025-08-17 05:15:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 944.729801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.X........X...............................] duration:
820.739998ms
FAIL (2025-08-17 05:15:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.788501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.........................X.............X................] duration:
2.791579921s
FAIL (2025-08-17 05:14:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.791607319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.X........X..............................] duration:
818.080216ms
FAIL (2025-08-17 05:14:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.112355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.........................X.............X...............] duration:
2.346560858s
FAIL (2025-08-17 05:13:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.346595322s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.X........X.............................] duration:
828.17696ms
FAIL (2025-08-17 05:13:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.207438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.X........X............................] duration:
844.805884ms
FAIL (2025-08-17 05:13:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.837456ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........................X.............X..............] duration:
2.500518443s
FAIL (2025-08-17 05:13:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.500547647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.........................X.............X.............] duration:
2.385893052s
FAIL (2025-08-17 05:12:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.385942091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.X........X...........................] duration:
846.250314ms
FAIL (2025-08-17 05:12:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.283767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........................X.............X............] duration:
2.660544416s
FAIL (2025-08-17 05:12:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.660572388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.X........X..........................] duration:
863.551211ms
FAIL (2025-08-17 05:11:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.586897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.956199019s
FAIL (2025-08-17 05:11:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.956227337s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.........................X.............X...........] duration:
2.45201943s
FAIL (2025-08-17 05:11:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.452050984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........................X.............X..........] duration:
2.419609818s
FAIL (2025-08-17 05:11:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.419658686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.814068202s
FAIL (2025-08-17 05:10:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.814097368s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.X........X.........................] duration:
815.378967ms
FAIL (2025-08-17 05:10:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.408875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
2.814650583s
FAIL (2025-08-17 05:10:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.814685412s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.X........X........................] duration:
877.944984ms
FAIL (2025-08-17 05:10:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.979126ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........................X.............X.........] duration:
2.317642322s
FAIL (2025-08-17 05:09:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.317694708s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........................X.............X........] duration:
2.440032301s
FAIL (2025-08-17 05:09:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.44006209s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.X........X.......................] duration:
840.697825ms
FAIL (2025-08-17 05:09:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 04:52:29.864918009 (203h26m51.824015266s) [upload=211769]: Starting upload Aug 17 04:52:29.864987814 (203h26m51.824085071s) [upload=211769]: Done starting upload Aug 17 04:52:29.865067633 (203h26m51.82416488s) [upload=211769]: Uploading segments... Aug 17 04:52:29.865154190 (203h26m51.824251449s) [upload=211769]: Got next segment. Inline: true Aug 17 04:52:29.865161885 (203h26m51.824259137s) [upload=211769]: Waiting for error group managing segments... Aug 17 04:52:29.865211769 (203h26m51.824309016s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 04:52:29.865218162 (203h26m51.824315412s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 04:52:29.865222666 (203h26m51.824319916s) [upload=211769]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 04:52:29.961406445 (203h26m51.920503696s) [upload=211769]: Done uploading segments... Aug 17 04:52:29.961431277 (203h26m51.920528524s) [upload=211769]: Upload finished. err: metaclient: Too Many Requests
Duration: 840.728767ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.........................X.............X.......] duration:
2.324328163s
FAIL (2025-08-17 05:09:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 05:03:13.602511700 (203h37m35.561608946s) [upload=211959]: Starting upload
Aug 17 05:03:13.602579829 (203h37m35.561677075s) [upload=211959]: Done starting upload
Aug 17 05:03:13.602710980 (203h37m35.561808227s) [upload=211959]: Uploading segments...
Aug 17 05:03:13.603262465 (203h37m35.562359752s) [upload=211959]: Got next segment. Inline: false
Aug 17 05:03:13.603337276 (203h37m35.562434511s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 05:03:13.603343808 (203h37m35.562441054s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 05:03:13.799853325 (203h37m35.758950577s) [seg_pos={0 0}, upload=211959]: Begin upload segment...
Aug 17 05:03:13.800036220 (203h37m35.759133474s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.800177632 (203h37m35.759274878s) [seg_pos={0 0}, upload=211959]: Done begin upload segment.
Aug 17 05:03:13.800197764 (203h37m35.759295015s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801258837 (203h37m35.76035607s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801397102 (203h37m35.760494351s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.801990298 (203h37m35.761087551s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.802697918 (203h37m35.761795169s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803128784 (203h37m35.762226035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.803486952 (203h37m35.762584198s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804350699 (203h37m35.76344795s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.804699270 (203h37m35.763796515s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805076918 (203h37m35.764174172s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.805457355 (203h37m35.764554606s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807167900 (203h37m35.766265156s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.807742402 (203h37m35.766839651s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808118131 (203h37m35.767215401s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808544794 (203h37m35.767642045s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.808856024 (203h37m35.767953276s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:13.810151413 (203h37m35.769248662s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Uploading piece...
Aug 17 05:03:14.362743471 (203h37m36.32184071s) [upload=211959]: Next returned nil segment
Aug 17 05:03:14.362762027 (203h37m36.321859274s) [upload=211959]: Waiting for error group managing segments...
Aug 17 05:03:14.508461037 (203h37m36.467558284s) [noise=true , address=104.36.82.16:4308 , piece_id=7UZYKU6QEJVJIRVCZ4QHNZCREASFLZKYHFFZDHUOUV4SDOYOGV6A, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.511434934 (203h37m36.470532178s) [noise=true , address=77.90.31.14:4676 , piece_id=UVEJOV4L6N6XK7SO4Y34F4D2V5PM5TDFNXWK3NPWX54QF76S4NDA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522280687 (203h37m36.481377927s) [noise=true , address=45.91.116.6:4981 , piece_id=6CU7QZ5WFYCSNJEV66VWPB7AQU3I5HOFZ3C2ABMCWK2NAXB5C24Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.522473561 (203h37m36.481570806s) [noise=true , address=45.91.116.14:4203 , piece_id=WJTUBKR4XWNR4AM4PJNNIQUMZNDML6SUH2YTDQJIR3OLEVFVGPJA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.525492742 (203h37m36.484589981s) [noise=true , address=104.36.82.58:4276 , piece_id=2YKRD6EESPYAFGENOKXIQ56ZEKCP4KOX6LHYZZGSXBNO2CTSBWEQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.526788397 (203h37m36.485885632s) [noise=true , address=45.91.116.10:4103 , piece_id=HVL7DUDJZU75K4HXVEC4VHSY6CDLO4RPBX4IJDKXXAEFLU3OZWLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.527513729 (203h37m36.486610965s) [noise=true , address=77.90.31.11:4580 , piece_id=EUBM2QZBJW5ARJCDWCQXN357DQJAYGYFSJCS32X5LZU3MYIS47FA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.530297757 (203h37m36.489394988s) [noise=true , address=77.90.31.16:4757 , piece_id=2ZZBHLMYXJISW4U6UJL3QOSNJXLR2QCWMHC76O4IXLLN7CX2DFUQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.531686830 (203h37m36.490784089s) [noise=true , address=77.90.31.10:4545 , piece_id=5XOPWNEWQBNYSGJ26RAUMMRTRQ2EDVYFCPMCMZ3XCS7M4FU77TZA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.539828385 (203h37m36.498925618s) [noise=true , address=77.90.31.21:4899 , piece_id=5KTNSD35RSMCMLYZBFRF7OVJQEM5LWO5QJZW3N56LGWYAYXZ43VQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.557167794 (203h37m36.516265035s) [noise=true , address=104.36.82.5:4866 , piece_id=CS4BGNYPULI3THDJXS3YMKL4DCB7BKKWZLKQCXYKH4GATV3QSWBA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.563369778 (203h37m36.52246703s) [noise=true , address=77.90.31.18:4811 , piece_id=3IFVP5JALFTI7LMOB6Z2I7AM76AXMUEMXN3LNEIDI33X7T2T6DLQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.567463984 (203h37m36.52656123s) [noise=true , address=104.36.82.59:4325 , piece_id=7EQFGGJAASXBUZTKMYO6EVTZFO7KLPA2XL6VDZQBFQOSDHYALPPQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685114757 (203h37m36.644211993s) [noise=true , address=104.36.82.23:4464 , piece_id=372GUNFP52QXR7EOT6YJHFKOIVEKQUJQZFM7R3AXD4Q6AQHBZ5NA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: <nil>
Aug 17 05:03:14.685164773 (203h37m36.644262018s) [seg_pos={0 0}, upload=211959]: Segment reached optimal threshold of 14 pieces.
Aug 17 05:03:14.685471845 (203h37m36.64456909s) [noise=true , address=104.36.82.60:4371 , piece_id=76GG3IT2FKXUQWKCKZFFVYD453U2L572O6XTJY6XF6TZD3EPZZXQ, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KJP5DHmfnSFQF3Q74GzMUvcAz9zh16td4pnsqHAwToiM4D1vd): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685585241 (203h37m36.644682487s) [noise=true , address=79.127.220.101:4063 , piece_id=XHMZRVZ75MULVF3K52QMPYLDEV57Q2KLAP4I6V5HDFO5KXI5QW4Q, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CAoTJPUeWPgEvSCtaBQqVK15E8jF448WGHs4yAfP6GH2mtC1x): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685605870 (203h37m36.644703119s) [noise=true , address=66.23.193.175:4561 , piece_id=UNZOW37VOG7JAEAG3ERK4TJQ3ZPFBK55TK3YK7RG4254MZ6QEJTA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45824->66.23.193.175:4561: use of closed network connection
Aug 17 05:03:14.685664837 (203h37m36.644762081s) [noise=true , address=79.127.201.215:4353 , piece_id=LUV57WW5M462PKQ5RRXV54FEWJCNH3NZKE3TOO2DZIL55W4O3XHA, seg_pos={0 0}, upload=211959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 17 05:03:14.685688107 (203h37m36.644785342s) [seg_pos={0 0}, upload=211959]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 05:03:14.685790677 (203h37m36.644887913s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 05:03:14.685796312 (203h37m36.644893557s) [upload=211959]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 05:03:14.842181821 (203h37m36.801279077s) [upload=211959]: Done uploading segments...
Aug 17 05:03:14.842207356 (203h37m36.801304612s) [upload=211959]: Upload finished. err: <nil>
Duration: 2.324360823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................] duration:
3.056660554s
FAIL (2025-08-17 05:09:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.056691455s
edge
gateway
us-select-1
|