Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X...........................X........X..............X......] duration:
843.642878ms
FAIL (2025-08-11 10:58:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.67811ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X...........................X........X..............X.....] duration:
856.969752ms
FAIL (2025-08-11 10:57:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.001424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X............................X...X.....] duration:
2.507551883s
FAIL (2025-08-11 10:57:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 2.50758709s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X...........................X........X..............X....] duration:
955.815718ms
FAIL (2025-08-11 10:56:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.844489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X............................X...X....] duration:
2.438854677s
FAIL (2025-08-11 10:56:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 2.438931871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X...........................X........X..............X...] duration:
817.861688ms
FAIL (2025-08-11 10:55:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.950174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X............................X...X...] duration:
2.444774509s
FAIL (2025-08-11 10:55:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 2.444800548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X............................X...X..] duration:
2.666497482s
FAIL (2025-08-11 10:54:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 2.666520695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X...........................X........X..............X..] duration:
837.17426ms
FAIL (2025-08-11 10:54:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.216554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X............................X...X.] duration:
2.378148264s
FAIL (2025-08-11 10:54:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 2.378176944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X............................X...X] duration:
1.652861408s
FAIL (2025-08-11 10:53:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:53:36.482484969 (65h27m58.441582205s) [upload=68208]: Starting upload
Aug 11 10:53:36.482547461 (65h27m58.441644715s) [upload=68208]: Done starting upload
Aug 11 10:53:36.482865366 (65h27m58.441962601s) [upload=68208]: Uploading segments...
Aug 11 10:53:36.482925787 (65h27m58.442023042s) [upload=68208]: Got next segment. Inline: false
Aug 11 10:53:36.482980675 (65h27m58.44207792s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:53:36.482986308 (65h27m58.442083553s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:53:36.680631123 (65h27m58.63972837s) [seg_pos={0 0}, upload=68208]: Begin upload segment...
Aug 11 10:53:36.680709439 (65h27m58.639806678s) [seg_pos={0 0}, upload=68208]: Done begin upload segment.
Aug 11 10:53:36.680785052 (65h27m58.639882302s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.680849971 (65h27m58.63994722s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681180651 (65h27m58.640277896s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681367138 (65h27m58.640464388s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681428386 (65h27m58.640525631s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681674107 (65h27m58.640771352s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681858007 (65h27m58.640955256s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.681907623 (65h27m58.641004869s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682196152 (65h27m58.641293383s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682402848 (65h27m58.641500095s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682534216 (65h27m58.641631473s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682862754 (65h27m58.641960005s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.682936622 (65h27m58.642033872s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683159566 (65h27m58.64225681s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.683434723 (65h27m58.64253197s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.686633304 (65h27m58.645730555s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687434722 (65h27m58.646531976s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:36.687742743 (65h27m58.646839988s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Uploading piece...
Aug 11 10:53:37.238482831 (65h27m59.197580064s) [upload=68208]: Next returned nil segment
Aug 11 10:53:37.238498541 (65h27m59.197595787s) [upload=68208]: Waiting for error group managing segments...
Aug 11 10:53:37.408430524 (65h27m59.367527761s) [noise=true , address=77.90.31.21:4886 , piece_id=FPSBFRETAFNBUFHLJYRLMD22G5Q2AMRFPE2YHCVLTQP72WJA2VBQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.415738933 (65h27m59.374836172s) [noise=true , address=104.36.82.60:4344 , piece_id=76WSKSOWXGZTAJHLPQXR7E6TRKORW7VVRFZ2SW7DJH2UHTMKVX4A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.418747318 (65h27m59.377844568s) [noise=true , address=104.36.82.36:4632 , piece_id=K4VALNJWYBCNPEXGJZSGFMBFCDLTTBAN2XUUBLA7DLZRG5EG2AWA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.420407421 (65h27m59.379504653s) [noise=true , address=104.36.82.9:4019 , piece_id=DCGUCVJ5YESZDXKDZTFFU4VCMX5GBUKNH6UV2NXVKGF2NMX7CWGA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.423310522 (65h27m59.382407755s) [noise=true , address=104.36.82.39:4736 , piece_id=K6VWOQUPDKMSFNR7YX5EEP44BUOAV2MNJ2C2KCBTYDHVVMJ45UXQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.426505894 (65h27m59.38560313s) [noise=true , address=104.36.82.59:4309 , piece_id=MBMUN4LPUNI4SPGLRKP5YRIJ5FVX7GEXFBBYLACD52ZFD4GOJ3EQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.427557423 (65h27m59.386654655s) [noise=true , address=104.36.82.8:4988 , piece_id=CVCRCCST7SPY7PXMA2RUU3F3P3BNGWULH5FIZXVYOJ4TT4CK3CJQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.430752668 (65h27m59.389849906s) [noise=true , address=104.36.82.34:4576 , piece_id=XXVCCQRY6LADDFBWVCTNJOJIEW2AIAVEE5YVD4LB5P7BZGQL74NQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.431087761 (65h27m59.390184992s) [noise=true , address=104.36.82.4:4833 , piece_id=H6XEMANYRORZ62L2JU6RKNVVQEEDM7XYDXCDXGIE5AYI436UFVBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438287439 (65h27m59.397384686s) [noise=true , address=104.36.82.37:4678 , piece_id=GEF4WX2JATCXSDT2SX7BHYHJQQVQ4QES57PFH375V2IJ2IPY6UEA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.438363679 (65h27m59.397460916s) [noise=true , address=104.36.82.18:4366 , piece_id=RG3FJ5VORHZHGM52MKVVIVGHCCQHDJKHQIP7GU7WMWAK5CFRAJCQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446482991 (65h27m59.405580236s) [noise=true , address=104.36.82.62:4438 , piece_id=CQOTAJNEMQYXKPQUV6KW7XIYC3KEE7WYE3YWYEEFX4MEJ7UBQHJA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.446501648 (65h27m59.405598888s) [noise=true , address=104.36.82.19:4410 , piece_id=EWQZA4V554ZQPCY7TAVFRDOVNEJVKF6XK74AIIHN3ZYEUGVJ4HDA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492138337 (65h27m59.451235575s) [noise=true , address=104.36.82.58:4288 , piece_id=EG57S2P27QSFPSJQ3SULIKSWZSGROYNZDT4RM4QDU6XJ2IWG2ZBA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: <nil>
Aug 11 10:53:37.492188360 (65h27m59.451285606s) [seg_pos={0 0}, upload=68208]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:53:37.492401200 (65h27m59.451498438s) [noise=true , address=104.36.82.47:4532 , piece_id=7A5XRX3LA4KDW5U5KXZK7E6UC2V4ZBL2OIJ3UJP57AJED7D26O6Q, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15buPXDh9xXPzcL5Z7q2XZTQujajVRBp97VnPp5ngUDQL26AbL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492552813 (65h27m59.451650052s) [noise=true , address=77.90.31.15:4707 , piece_id=JB5PUAAR7LS644RPAEZRHOGZAPVK5IPKMY53ZVSNV4YZX2LXGU2A, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.492900009 (65h27m59.451997245s) [noise=true , address=64.49.13.138:4490 , piece_id=VG6GS56ZXSR2ZWPPAF5PCTSTALOOPXKDJE63EUFF2N7JWEBOF7GQ, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58554->64.49.13.138:4490: use of closed network connection
Aug 11 10:53:37.492999118 (65h27m59.452096354s) [noise=true , address=104.36.82.44:4902 , piece_id=OF6BCNIP4B3FRJ6G4AQ2SM6XOADCRTFNZDACRNYULBKXZ56Q2ZMA, seg_pos={0 0}, upload=68208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Be9T5kXUwLU3C6wBeKFV3Q7aZFbZDTNG1oaEft8V6rmySUcEE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:53:37.493031481 (65h27m59.452128728s) [seg_pos={0 0}, upload=68208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:53:37.493126522 (65h27m59.452223767s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:53:37.493131980 (65h27m59.452229225s) [upload=68208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:53:37.669553560 (65h27m59.628650792s) [upload=68208]: Done uploading segments...
Aug 11 10:53:37.669574047 (65h27m59.628671279s) [upload=68208]: Upload finished. err: <nil>
Duration: 1.652889239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X...........................X........X..............X.] duration:
927.466617ms
FAIL (2025-08-11 10:53:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 927.492653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X...........................X........X..............X] duration:
357.44445ms
FAIL (2025-08-11 10:52:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:52:56.522630844 (65h27m18.481728098s) [upload=68197]: Starting upload Aug 11 10:52:56.522750996 (65h27m18.481848245s) [upload=68197]: Done starting upload Aug 11 10:52:56.522835794 (65h27m18.481933031s) [upload=68197]: Uploading segments... Aug 11 10:52:56.522900827 (65h27m18.481998076s) [upload=68197]: Got next segment. Inline: true Aug 11 10:52:56.522906517 (65h27m18.482003766s) [upload=68197]: Waiting for error group managing segments... Aug 11 10:52:56.522982102 (65h27m18.48207935s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:52:56.522987909 (65h27m18.482085154s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:52:56.522992061 (65h27m18.482089307s) [upload=68197]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:52:56.610819113 (65h27m18.569916347s) [upload=68197]: Done uploading segments... Aug 11 10:52:56.610838979 (65h27m18.569936219s) [upload=68197]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.51918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............................X...] duration:
2.374130087s
FAIL (2025-08-11 10:52:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:49:44.004765238 (65h24m5.963862486s) [upload=68140]: Starting upload
Aug 11 10:49:44.004851965 (65h24m5.963949217s) [upload=68140]: Done starting upload
Aug 11 10:49:44.005060272 (65h24m5.96415751s) [upload=68140]: Uploading segments...
Aug 11 10:49:44.005257577 (65h24m5.964354829s) [upload=68140]: Got next segment. Inline: false
Aug 11 10:49:44.005306232 (65h24m5.96440348s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:49:44.005313125 (65h24m5.964410374s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:49:44.201124804 (65h24m6.16022207s) [seg_pos={0 0}, upload=68140]: Begin upload segment...
Aug 11 10:49:44.201179200 (65h24m6.160276436s) [seg_pos={0 0}, upload=68140]: Done begin upload segment.
Aug 11 10:49:44.201230942 (65h24m6.16032819s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.201752501 (65h24m6.160849751s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202080190 (65h24m6.161177478s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202246618 (65h24m6.16134387s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202539496 (65h24m6.161636753s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202631099 (65h24m6.161728348s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202919170 (65h24m6.162016425s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202962620 (65h24m6.162059871s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203315330 (65h24m6.162412581s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203335285 (65h24m6.162432536s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203700503 (65h24m6.162797752s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203725179 (65h24m6.162822436s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.204121933 (65h24m6.163219191s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205245988 (65h24m6.164343242s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205610852 (65h24m6.164708104s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.206025444 (65h24m6.1651227s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209286926 (65h24m6.168384182s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209756444 (65h24m6.168853684s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.774764003 (65h24m6.733861236s) [upload=68140]: Next returned nil segment
Aug 11 10:49:44.774782815 (65h24m6.733880046s) [upload=68140]: Waiting for error group managing segments...
Aug 11 10:49:44.922999915 (65h24m6.882097155s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.927466583 (65h24m6.886563822s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930795118 (65h24m6.889892364s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930862015 (65h24m6.889959252s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.933601333 (65h24m6.892698571s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.937477944 (65h24m6.896575182s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.939599694 (65h24m6.898696942s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.948628143 (65h24m6.907725382s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.958999180 (65h24m6.918096426s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.963707427 (65h24m6.922804681s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.965616106 (65h24m6.924713352s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.003189830 (65h24m6.962287079s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.006824357 (65h24m6.965921612s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434241059 (65h24m7.393338294s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434269121 (65h24m7.393366367s) [seg_pos={0 0}, upload=68140]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:49:45.434438728 (65h24m7.393535973s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434593236 (65h24m7.393690481s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434695977 (65h24m7.393793216s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434740407 (65h24m7.393837652s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434773866 (65h24m7.393871111s) [seg_pos={0 0}, upload=68140]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:49:45.434862883 (65h24m7.393960129s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:49:45.434868174 (65h24m7.393965418s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:49:45.582938431 (65h24m7.542035676s) [upload=68140]: Done uploading segments...
Aug 11 10:49:45.582962926 (65h24m7.542060166s) [upload=68140]: Upload finished. err: <nil>
Duration: 2.374176362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X............................X..] duration:
2.239721065s
FAIL (2025-08-11 10:51:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:49:44.004765238 (65h24m5.963862486s) [upload=68140]: Starting upload
Aug 11 10:49:44.004851965 (65h24m5.963949217s) [upload=68140]: Done starting upload
Aug 11 10:49:44.005060272 (65h24m5.96415751s) [upload=68140]: Uploading segments...
Aug 11 10:49:44.005257577 (65h24m5.964354829s) [upload=68140]: Got next segment. Inline: false
Aug 11 10:49:44.005306232 (65h24m5.96440348s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:49:44.005313125 (65h24m5.964410374s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:49:44.201124804 (65h24m6.16022207s) [seg_pos={0 0}, upload=68140]: Begin upload segment...
Aug 11 10:49:44.201179200 (65h24m6.160276436s) [seg_pos={0 0}, upload=68140]: Done begin upload segment.
Aug 11 10:49:44.201230942 (65h24m6.16032819s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.201752501 (65h24m6.160849751s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202080190 (65h24m6.161177478s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202246618 (65h24m6.16134387s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202539496 (65h24m6.161636753s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202631099 (65h24m6.161728348s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202919170 (65h24m6.162016425s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202962620 (65h24m6.162059871s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203315330 (65h24m6.162412581s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203335285 (65h24m6.162432536s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203700503 (65h24m6.162797752s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203725179 (65h24m6.162822436s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.204121933 (65h24m6.163219191s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205245988 (65h24m6.164343242s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205610852 (65h24m6.164708104s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.206025444 (65h24m6.1651227s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209286926 (65h24m6.168384182s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209756444 (65h24m6.168853684s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.774764003 (65h24m6.733861236s) [upload=68140]: Next returned nil segment
Aug 11 10:49:44.774782815 (65h24m6.733880046s) [upload=68140]: Waiting for error group managing segments...
Aug 11 10:49:44.922999915 (65h24m6.882097155s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.927466583 (65h24m6.886563822s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930795118 (65h24m6.889892364s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930862015 (65h24m6.889959252s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.933601333 (65h24m6.892698571s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.937477944 (65h24m6.896575182s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.939599694 (65h24m6.898696942s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.948628143 (65h24m6.907725382s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.958999180 (65h24m6.918096426s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.963707427 (65h24m6.922804681s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.965616106 (65h24m6.924713352s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.003189830 (65h24m6.962287079s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.006824357 (65h24m6.965921612s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434241059 (65h24m7.393338294s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434269121 (65h24m7.393366367s) [seg_pos={0 0}, upload=68140]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:49:45.434438728 (65h24m7.393535973s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434593236 (65h24m7.393690481s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434695977 (65h24m7.393793216s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434740407 (65h24m7.393837652s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434773866 (65h24m7.393871111s) [seg_pos={0 0}, upload=68140]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:49:45.434862883 (65h24m7.393960129s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:49:45.434868174 (65h24m7.393965418s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:49:45.582938431 (65h24m7.542035676s) [upload=68140]: Done uploading segments...
Aug 11 10:49:45.582962926 (65h24m7.542060166s) [upload=68140]: Upload finished. err: <nil>
Duration: 2.239754437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...........................X........X..............] duration:
829.482452ms
FAIL (2025-08-11 10:51:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 829.516418ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...........................X........X.............] duration:
823.479506ms
FAIL (2025-08-11 10:51:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 823.510619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X............................X.] duration:
2.49486711s
FAIL (2025-08-11 10:50:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:49:44.004765238 (65h24m5.963862486s) [upload=68140]: Starting upload
Aug 11 10:49:44.004851965 (65h24m5.963949217s) [upload=68140]: Done starting upload
Aug 11 10:49:44.005060272 (65h24m5.96415751s) [upload=68140]: Uploading segments...
Aug 11 10:49:44.005257577 (65h24m5.964354829s) [upload=68140]: Got next segment. Inline: false
Aug 11 10:49:44.005306232 (65h24m5.96440348s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:49:44.005313125 (65h24m5.964410374s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:49:44.201124804 (65h24m6.16022207s) [seg_pos={0 0}, upload=68140]: Begin upload segment...
Aug 11 10:49:44.201179200 (65h24m6.160276436s) [seg_pos={0 0}, upload=68140]: Done begin upload segment.
Aug 11 10:49:44.201230942 (65h24m6.16032819s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.201752501 (65h24m6.160849751s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202080190 (65h24m6.161177478s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202246618 (65h24m6.16134387s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202539496 (65h24m6.161636753s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202631099 (65h24m6.161728348s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202919170 (65h24m6.162016425s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202962620 (65h24m6.162059871s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203315330 (65h24m6.162412581s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203335285 (65h24m6.162432536s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203700503 (65h24m6.162797752s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203725179 (65h24m6.162822436s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.204121933 (65h24m6.163219191s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205245988 (65h24m6.164343242s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205610852 (65h24m6.164708104s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.206025444 (65h24m6.1651227s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209286926 (65h24m6.168384182s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209756444 (65h24m6.168853684s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.774764003 (65h24m6.733861236s) [upload=68140]: Next returned nil segment
Aug 11 10:49:44.774782815 (65h24m6.733880046s) [upload=68140]: Waiting for error group managing segments...
Aug 11 10:49:44.922999915 (65h24m6.882097155s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.927466583 (65h24m6.886563822s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930795118 (65h24m6.889892364s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930862015 (65h24m6.889959252s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.933601333 (65h24m6.892698571s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.937477944 (65h24m6.896575182s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.939599694 (65h24m6.898696942s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.948628143 (65h24m6.907725382s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.958999180 (65h24m6.918096426s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.963707427 (65h24m6.922804681s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.965616106 (65h24m6.924713352s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.003189830 (65h24m6.962287079s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.006824357 (65h24m6.965921612s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434241059 (65h24m7.393338294s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434269121 (65h24m7.393366367s) [seg_pos={0 0}, upload=68140]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:49:45.434438728 (65h24m7.393535973s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434593236 (65h24m7.393690481s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434695977 (65h24m7.393793216s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434740407 (65h24m7.393837652s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434773866 (65h24m7.393871111s) [seg_pos={0 0}, upload=68140]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:49:45.434862883 (65h24m7.393960129s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:49:45.434868174 (65h24m7.393965418s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:49:45.582938431 (65h24m7.542035676s) [upload=68140]: Done uploading segments...
Aug 11 10:49:45.582962926 (65h24m7.542060166s) [upload=68140]: Upload finished. err: <nil>
Duration: 2.494963392s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...........................X........X............] duration:
812.668935ms
FAIL (2025-08-11 10:50:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 812.703763ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X............................X] duration:
2.04760771s
FAIL (2025-08-11 10:49:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 11 10:49:44.004765238 (65h24m5.963862486s) [upload=68140]: Starting upload
Aug 11 10:49:44.004851965 (65h24m5.963949217s) [upload=68140]: Done starting upload
Aug 11 10:49:44.005060272 (65h24m5.96415751s) [upload=68140]: Uploading segments...
Aug 11 10:49:44.005257577 (65h24m5.964354829s) [upload=68140]: Got next segment. Inline: false
Aug 11 10:49:44.005306232 (65h24m5.96440348s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 10:49:44.005313125 (65h24m5.964410374s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 10:49:44.201124804 (65h24m6.16022207s) [seg_pos={0 0}, upload=68140]: Begin upload segment...
Aug 11 10:49:44.201179200 (65h24m6.160276436s) [seg_pos={0 0}, upload=68140]: Done begin upload segment.
Aug 11 10:49:44.201230942 (65h24m6.16032819s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.201752501 (65h24m6.160849751s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202080190 (65h24m6.161177478s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202246618 (65h24m6.16134387s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202539496 (65h24m6.161636753s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202631099 (65h24m6.161728348s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202919170 (65h24m6.162016425s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.202962620 (65h24m6.162059871s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203315330 (65h24m6.162412581s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203335285 (65h24m6.162432536s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203700503 (65h24m6.162797752s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.203725179 (65h24m6.162822436s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.204121933 (65h24m6.163219191s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205245988 (65h24m6.164343242s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.205610852 (65h24m6.164708104s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.206025444 (65h24m6.1651227s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209286926 (65h24m6.168384182s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.209756444 (65h24m6.168853684s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Uploading piece...
Aug 11 10:49:44.774764003 (65h24m6.733861236s) [upload=68140]: Next returned nil segment
Aug 11 10:49:44.774782815 (65h24m6.733880046s) [upload=68140]: Waiting for error group managing segments...
Aug 11 10:49:44.922999915 (65h24m6.882097155s) [noise=true , address=104.36.82.22:4520 , piece_id=FIPFKARZ3T5FAZ7L6JYKRIDZ74UIIJLXE33XZQH32KUTGO4KUYOQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.927466583 (65h24m6.886563822s) [noise=true , address=104.36.82.23:4463 , piece_id=NK3YA2CAH6HS3EEKMCT35A72LL52TVVNKJLRMTOGJ56PD7CV2B7Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930795118 (65h24m6.889892364s) [noise=true , address=45.91.116.6:4988 , piece_id=BUEHYCNT5AG3XRUCRRDDQ66VQ6W6MK7KMNAKNDOHWJCLLUWSZKDA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.930862015 (65h24m6.889959252s) [noise=true , address=104.36.82.9:4015 , piece_id=GZ67XCULB4KCNVAPXLSD5LKZAL2ZLFKRW5OEDJXDOCLJ7ZV2GLXQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.933601333 (65h24m6.892698571s) [noise=true , address=104.36.82.37:4659 , piece_id=T33VIML2HRE6EETLFJRE6H3RRGFCRZ4Q5TCLLRZMCJN7FTYUDAHQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.937477944 (65h24m6.896575182s) [noise=true , address=104.36.82.36:4624 , piece_id=DM3EUOWJGX6UCPZG7R35DHYNOVYE47SLAUWTA4A7NTNLI4RC4WRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.939599694 (65h24m6.898696942s) [noise=true , address=104.36.82.15:4262 , piece_id=YYVZI6IH2RCYHXTSJ4NXNI4LMV5ZCNVEUHMKW62RUWL3WBRPQFOA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.948628143 (65h24m6.907725382s) [noise=true , address=104.36.82.61:4406 , piece_id=4BMW2ITW7H2V4PNOQLZQGHVTROALG7FHDPEZN7XXWNZ5E6UF5QRA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.958999180 (65h24m6.918096426s) [noise=true , address=104.36.82.62:4412 , piece_id=MYVM3EOU2K5GJNWDO4Y4OPEBGLTYUYOAJ3VCBVH7TVHQNF3CKJUA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.963707427 (65h24m6.922804681s) [noise=true , address=104.36.82.45:4906 , piece_id=CORWSVSQEMBV32BVSYHVQO4VHRBTTEVVPKK65NUTE56DOE2KUXAA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:44.965616106 (65h24m6.924713352s) [noise=true , address=104.36.82.58:4293 , piece_id=MW4VUIDI55AYN335NVZGVEZDOLJLQ5TUQFAMHDPY7ZMWQEHBKEWA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.003189830 (65h24m6.962287079s) [noise=true , address=104.36.82.34:4554 , piece_id=UEKGE5GZYYF5MK6VG3DUH2G7JHON6JKITCEVLJMZXKEPQSYM7NLA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.006824357 (65h24m6.965921612s) [noise=true , address=104.36.82.44:4899 , piece_id=6PYX7SONE67YPO3V7IYHWN3LADGIRF22LRRVFEWU63NLYBYVFE4Q, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434241059 (65h24m7.393338294s) [noise=true , address=64.49.13.139:4469 , piece_id=AFPVZH6KF72CSEXNZ2VEYZNUVJUD4YQQYDIRU7UXLL4I7WAPO5PA, seg_pos={0 0}, upload=68140]: Done uploading piece. err: <nil>
Aug 11 10:49:45.434269121 (65h24m7.393366367s) [seg_pos={0 0}, upload=68140]: Segment reached optimal threshold of 14 pieces.
Aug 11 10:49:45.434438728 (65h24m7.393535973s) [noise=true , address=64.49.13.140:4506 , piece_id=2MKJAOV6GMOELHKXIL2ZHW35UUPM6SKOK6XVS3LISSQOS7ESKELQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434593236 (65h24m7.393690481s) [noise=true , address=64.49.13.169:4711 , piece_id=767ZO2IICOUPJX4TNNTN3NM3MATIQCLCDH4YS36NMWKWFO6B3KKQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nxT1Ldr46HPrDRHQ2nrwEBZT5bEVoPAAfBz86ZYwUH13sqwHu): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434695977 (65h24m7.393793216s) [noise=true , address=64.49.13.26:4953 , piece_id=UHTPHTFLPBS3OYZ4QRRRDBPDIRXCIT4EBMNL67UWVFKHFFBZXWIQ, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434740407 (65h24m7.393837652s) [noise=true , address=64.49.13.169:4707 , piece_id=ZUGKUPAXOYECC3B5R62OEGDN6UZ3UUN57FMUYPHFKR4OCOZZYL4A, seg_pos={0 0}, upload=68140]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: expected piece hash; context canceled; EOF
Aug 11 10:49:45.434773866 (65h24m7.393871111s) [seg_pos={0 0}, upload=68140]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 10:49:45.434862883 (65h24m7.393960129s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 10:49:45.434868174 (65h24m7.393965418s) [upload=68140]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 10:49:45.582938431 (65h24m7.542035676s) [upload=68140]: Done uploading segments...
Aug 11 10:49:45.582962926 (65h24m7.542060166s) [upload=68140]: Upload finished. err: <nil>
Duration: 2.047635825s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.345236354s
FAIL (2025-08-11 10:49:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.345272301s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X..........X...........................X........X...........] duration:
808.631294ms
FAIL (2025-08-11 10:49:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 808.658557ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.371492383s
FAIL (2025-08-11 10:49:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.371535199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..........X...........................X........X..........] duration:
837.739201ms
FAIL (2025-08-11 10:48:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 837.766595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.X..........X...........................X........X.........] duration:
825.563949ms
FAIL (2025-08-11 10:48:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 825.603982ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.430124016s
FAIL (2025-08-11 10:47:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.430165321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.X..........X...........................X........X........] duration:
829.829463ms
FAIL (2025-08-11 10:47:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 829.85897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.407903546s
FAIL (2025-08-11 10:46:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.407936778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.X..........X...........................X........X.......] duration:
828.725274ms
FAIL (2025-08-11 10:46:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 828.754738ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.33734506s
FAIL (2025-08-11 10:46:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.33737713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.X..........X...........................X........X......] duration:
877.756358ms
FAIL (2025-08-11 10:45:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 877.783707ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.X..........X...........................X........X.....] duration:
809.909934ms
FAIL (2025-08-11 10:45:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 809.935763ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.421628637s
FAIL (2025-08-11 10:45:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.421667002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.X..........X...........................X........X....] duration:
842.947368ms
FAIL (2025-08-11 10:44:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 842.972183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.465905197s
FAIL (2025-08-11 10:44:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.465941725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.X..........X...........................X........X...] duration:
1.015732163s
FAIL (2025-08-11 10:43:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 1.015761787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.290246938s
FAIL (2025-08-11 10:43:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.290289592s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.292907603s
FAIL (2025-08-11 10:43:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.292944551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.334539739s
FAIL (2025-08-11 10:42:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.334568267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.X..........X...........................X........X..] duration:
1.084722361s
FAIL (2025-08-11 10:42:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 1.084751451s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.449871355s
FAIL (2025-08-11 10:41:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.449901972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.X..........X...........................X........X.] duration:
881.432501ms
FAIL (2025-08-11 10:41:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 881.543865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.38850081s
FAIL (2025-08-11 10:40:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.38853976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X..........X...........................X........X] duration:
736.672044ms
FAIL (2025-08-11 10:40:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 53d1c83517463854b676faf5cb185328d42d19428f54ef1e5b59e5fb8526d11c != before 2ba1b2843aaa6ed45c2affdbce9595de2d151c61279962d35e4042f4d2b52cde ======LOGS====== Aug 11 10:40:36.663434137 (65h14m58.622531393s) [upload=67986]: Starting upload Aug 11 10:40:36.663500338 (65h14m58.622597586s) [upload=67986]: Done starting upload Aug 11 10:40:36.663572727 (65h14m58.622669973s) [upload=67986]: Uploading segments... Aug 11 10:40:36.663617336 (65h14m58.62271459s) [upload=67986]: Got next segment. Inline: true Aug 11 10:40:36.663622594 (65h14m58.622719832s) [upload=67986]: Waiting for error group managing segments... Aug 11 10:40:36.663671383 (65h14m58.622768628s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:40:36.663676488 (65h14m58.622773724s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:40:36.663679979 (65h14m58.622777215s) [upload=67986]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:40:36.808584058 (65h14m58.767681295s) [upload=67986]: Done uploading segments... Aug 11 10:40:36.808604447 (65h14m58.767701684s) [upload=67986]: Upload finished. err: <nil>
Duration: 736.699844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.326011887s
FAIL (2025-08-11 10:39:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.326049253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.323028063s
FAIL (2025-08-11 10:39:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.323056989s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X..........X...........................X........] duration:
809.873912ms
FAIL (2025-08-11 10:39:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after fdfdab1af70efa8b474e9dfe76f84ebf5db6c267e5c6889034bc83f5226089b5 != before 125d4aa8e964dba9c2cb9d83854f1021c2b9354eaa8ea7a8e0f25cc268f378a1 ======LOGS====== Aug 11 10:34:33.071508494 (65h8m55.030605732s) [upload=67883]: Starting upload Aug 11 10:34:33.071563804 (65h8m55.030661052s) [upload=67883]: Done starting upload Aug 11 10:34:33.071646588 (65h8m55.030743826s) [upload=67883]: Uploading segments... Aug 11 10:34:33.071723855 (65h8m55.030821102s) [upload=67883]: Got next segment. Inline: true Aug 11 10:34:33.071730103 (65h8m55.030827349s) [upload=67883]: Waiting for error group managing segments... Aug 11 10:34:33.071773124 (65h8m55.030870358s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:34:33.071778121 (65h8m55.030875367s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:34:33.071781661 (65h8m55.030878906s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:34:33.322604507 (65h8m55.281701755s) [upload=67883]: Done uploading segments... Aug 11 10:34:33.322625138 (65h8m55.281722377s) [upload=67883]: Upload finished. err: <nil>
Duration: 809.902339ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.X..........X...........................X.......] duration:
827.738716ms
FAIL (2025-08-11 10:38:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after fdfdab1af70efa8b474e9dfe76f84ebf5db6c267e5c6889034bc83f5226089b5 != before 125d4aa8e964dba9c2cb9d83854f1021c2b9354eaa8ea7a8e0f25cc268f378a1 ======LOGS====== Aug 11 10:34:33.071508494 (65h8m55.030605732s) [upload=67883]: Starting upload Aug 11 10:34:33.071563804 (65h8m55.030661052s) [upload=67883]: Done starting upload Aug 11 10:34:33.071646588 (65h8m55.030743826s) [upload=67883]: Uploading segments... Aug 11 10:34:33.071723855 (65h8m55.030821102s) [upload=67883]: Got next segment. Inline: true Aug 11 10:34:33.071730103 (65h8m55.030827349s) [upload=67883]: Waiting for error group managing segments... Aug 11 10:34:33.071773124 (65h8m55.030870358s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:34:33.071778121 (65h8m55.030875367s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:34:33.071781661 (65h8m55.030878906s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:34:33.322604507 (65h8m55.281701755s) [upload=67883]: Done uploading segments... Aug 11 10:34:33.322625138 (65h8m55.281722377s) [upload=67883]: Upload finished. err: <nil>
Duration: 827.774164ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.537910497s
FAIL (2025-08-11 10:38:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 10:28:38.902283329 (65h3m0.861380576s) [upload=67780]: Starting upload Aug 11 10:28:38.902345271 (65h3m0.861442516s) [upload=67780]: Done starting upload Aug 11 10:28:38.902467514 (65h3m0.861564752s) [upload=67780]: Uploading segments... Aug 11 10:28:38.902632357 (65h3m0.861729602s) [upload=67780]: Got next segment. Inline: false Aug 11 10:28:38.902680413 (65h3m0.861777659s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:28:38.902686446 (65h3m0.861783691s) [upload=67780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 10:28:38.991174631 (65h3m0.950271877s) [upload=67780]: Next segment err: metaclient: Too Many Requests Aug 11 10:28:38.991203463 (65h3m0.95030072s) [upload=67780]: Done uploading segments... Aug 11 10:28:38.991227676 (65h3m0.950324923s) [upload=67780]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.537939352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X...........X.X..........X...........................X......] duration:
911.426741ms
FAIL (2025-08-11 10:37:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after fdfdab1af70efa8b474e9dfe76f84ebf5db6c267e5c6889034bc83f5226089b5 != before 125d4aa8e964dba9c2cb9d83854f1021c2b9354eaa8ea7a8e0f25cc268f378a1 ======LOGS====== Aug 11 10:34:33.071508494 (65h8m55.030605732s) [upload=67883]: Starting upload Aug 11 10:34:33.071563804 (65h8m55.030661052s) [upload=67883]: Done starting upload Aug 11 10:34:33.071646588 (65h8m55.030743826s) [upload=67883]: Uploading segments... Aug 11 10:34:33.071723855 (65h8m55.030821102s) [upload=67883]: Got next segment. Inline: true Aug 11 10:34:33.071730103 (65h8m55.030827349s) [upload=67883]: Waiting for error group managing segments... Aug 11 10:34:33.071773124 (65h8m55.030870358s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 10:34:33.071778121 (65h8m55.030875367s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 10:34:33.071781661 (65h8m55.030878906s) [upload=67883]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 10:34:33.322604507 (65h8m55.281701755s) [upload=67883]: Done uploading segments... Aug 11 10:34:33.322625138 (65h8m55.281722377s) [upload=67883]: Upload finished. err: <nil>
Duration: 911.459474ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|