Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X................X.................................X...X..] duration:
1.117803908s
FAIL (2025-08-22 22:29:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:27:16.415884812 (341h1m38.37498207s) [upload=354973]: Starting upload Aug 22 22:27:16.415988547 (341h1m38.375085803s) [upload=354973]: Done starting upload Aug 22 22:27:16.416121143 (341h1m38.375218388s) [upload=354973]: Uploading segments... Aug 22 22:27:16.416191250 (341h1m38.375288508s) [upload=354973]: Got next segment. Inline: true Aug 22 22:27:16.416197809 (341h1m38.375295063s) [upload=354973]: Waiting for error group managing segments... Aug 22 22:27:16.416265221 (341h1m38.375362475s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:27:16.416271906 (341h1m38.375369161s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:27:16.416276289 (341h1m38.375373539s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:27:16.504938910 (341h1m38.464036165s) [upload=354973]: Done uploading segments... Aug 22 22:27:16.504987336 (341h1m38.464084582s) [upload=354973]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.117836086s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.764206574s
FAIL (2025-08-22 22:29:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:28:52.292763761 (341h3m14.251861015s) [upload=355000]: Starting upload
Aug 22 22:28:52.292849717 (341h3m14.251946951s) [upload=355000]: Done starting upload
Aug 22 22:28:52.292962301 (341h3m14.25205955s) [upload=355000]: Uploading segments...
Aug 22 22:28:52.293274015 (341h3m14.252371272s) [upload=355000]: Got next segment. Inline: false
Aug 22 22:28:52.293342238 (341h3m14.252439494s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:28:52.293349224 (341h3m14.252446479s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:28:52.571223777 (341h3m14.530321035s) [seg_pos={0 0}, upload=355000]: Begin upload segment...
Aug 22 22:28:52.571331148 (341h3m14.530428396s) [noise=true , address=104.36.82.40:4948 , piece_id=6LZJGOXEF3GOLRZJQIGPYDX2YWLQA23O75KMHSVXLABIU5D5OCZA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.572355082 (341h3m14.531452349s) [seg_pos={0 0}, upload=355000]: Done begin upload segment.
Aug 22 22:28:52.572422865 (341h3m14.531520121s) [noise=true , address=156.146.43.225:4462 , piece_id=VHXVL73TI3VG7AT4OADKANNMC2IYAJPZGMOMD566BCUIJZ6JCIRQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.572987759 (341h3m14.532085014s) [noise=true , address=45.91.116.13:4177 , piece_id=RMUWHPK35OZURKV7KFOW2VPUFRQHB4JRESYCF7Y6Y2GBFGA6P6QA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573106382 (341h3m14.532203638s) [noise=true , address=104.36.82.11:4120 , piece_id=QKIA762J5TOVP3RHGMQKH42BTUU75XIWNYJ4XNS7QFWG2NBXABWQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573519849 (341h3m14.532617095s) [noise=true , address=104.36.82.5:4844 , piece_id=L2NFD3TG4AAQLA4TEUNNOEDZNRPJDRNV36CKNYIMFSA7V6Q3OWXA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573866294 (341h3m14.532963544s) [noise=true , address=104.36.82.50:4023 , piece_id=53MHXC2I4I5R2LYSOUXKTBJXS33VDQDJUVRCS5XHJHRJCSCY6DRQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.574545651 (341h3m14.533642901s) [noise=true , address=45.91.116.10:4086 , piece_id=S77CKA6QF7N7Y475674MBNT3322UAACTVS2YQEJP6YOKMZSQLDCA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.574728219 (341h3m14.533825465s) [noise=true , address=77.90.31.21:4887 , piece_id=UEFRB4XBZEWGHBWRZZQK4REMCTNG2CJHQBBITMWBDNNSNGFWZHLQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.575345810 (341h3m14.534443055s) [noise=true , address=79.127.220.97:4374 , piece_id=USLVI4RQ5HBW3CB7RTN3PFYT3OI6Y4PW5YLTJ4LLLUYGSXOMX6ZA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.576072020 (341h3m14.535169273s) [noise=true , address=104.36.82.52:4106 , piece_id=QILQAOYJYDWLWKRKYDLYDBUX6X6WOHA2BG75QMB4IROZBGTR5G5A, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.576563870 (341h3m14.535661129s) [noise=true , address=104.36.82.60:4341 , piece_id=HSVE7XYRPFXFPBHI2GMF55C3DTZGQFEAWDI6XXW3UO32SI5I6E5A, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578098915 (341h3m14.537196176s) [noise=true , address=104.36.82.23:4447 , piece_id=IW2XXNZSDTYJGAIPQGPCKVJ3CPMBM6IAG7ZMHLVEV7ZJAZHYLSNA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578123251 (341h3m14.537220482s) [noise=true , address=104.36.82.13:4190 , piece_id=U6W57ZEALPXXVMQTSNYSRVMVKVVQUVZMRACT7DTBVCXURMR4EAOA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578544540 (341h3m14.537641795s) [noise=true , address=77.90.31.11:4559 , piece_id=RX7BM6LE6BYSL6JFA2U7CY6DVWXWYA23JBBZKDS6CEOBQHQ5XSGA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578882761 (341h3m14.537980016s) [noise=true , address=77.90.31.18:4828 , piece_id=BSAHX5S5HUZX7Y7ZXPM7T23KV2PDMJVOYTCMFF3R2OH4HDHWY2QQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.580083267 (341h3m14.539180504s) [noise=true , address=77.90.31.10:4525 , piece_id=7RU6FJ4CHGA5FELL4LUBHFDPN7QENJSNH2OK3A7M2INHPZ5NAVDA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.582261285 (341h3m14.541358526s) [noise=true , address=79.127.201.214:4290 , piece_id=7UHTR572JSL6VFIEYAOZ57ZMIXVRT6VD5UY5RUQRQUE7HO5TV7IA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.584663797 (341h3m14.543761047s) [noise=true , address=104.36.82.44:4902 , piece_id=SI4J2RSA55CNWG6XWMJY4VDU2TCLNOZALKO3V7WN5KP5MQRVOZQQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:53.130690470 (341h3m15.089787725s) [upload=355000]: Next returned nil segment
Aug 22 22:28:53.130715136 (341h3m15.089812391s) [upload=355000]: Waiting for error group managing segments...
Aug 22 22:28:53.290477119 (341h3m15.24957436s) [noise=true , address=45.91.116.13:4177 , piece_id=RMUWHPK35OZURKV7KFOW2VPUFRQHB4JRESYCF7Y6Y2GBFGA6P6QA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.311352230 (341h3m15.270449464s) [noise=true , address=104.36.82.44:4902 , piece_id=SI4J2RSA55CNWG6XWMJY4VDU2TCLNOZALKO3V7WN5KP5MQRVOZQQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.336272255 (341h3m15.295369487s) [noise=true , address=104.36.82.11:4120 , piece_id=QKIA762J5TOVP3RHGMQKH42BTUU75XIWNYJ4XNS7QFWG2NBXABWQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.346825886 (341h3m15.305923121s) [noise=true , address=104.36.82.13:4190 , piece_id=U6W57ZEALPXXVMQTSNYSRVMVKVVQUVZMRACT7DTBVCXURMR4EAOA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.349889005 (341h3m15.308986239s) [noise=true , address=104.36.82.23:4447 , piece_id=IW2XXNZSDTYJGAIPQGPCKVJ3CPMBM6IAG7ZMHLVEV7ZJAZHYLSNA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.361874624 (341h3m15.320971855s) [noise=true , address=104.36.82.60:4341 , piece_id=HSVE7XYRPFXFPBHI2GMF55C3DTZGQFEAWDI6XXW3UO32SI5I6E5A, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.365332047 (341h3m15.324429281s) [noise=true , address=104.36.82.50:4023 , piece_id=53MHXC2I4I5R2LYSOUXKTBJXS33VDQDJUVRCS5XHJHRJCSCY6DRQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.386793575 (341h3m15.345890807s) [noise=true , address=104.36.82.40:4948 , piece_id=6LZJGOXEF3GOLRZJQIGPYDX2YWLQA23O75KMHSVXLABIU5D5OCZA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.414649931 (341h3m15.373747166s) [noise=true , address=45.91.116.10:4086 , piece_id=S77CKA6QF7N7Y475674MBNT3322UAACTVS2YQEJP6YOKMZSQLDCA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.419787692 (341h3m15.378884944s) [noise=true , address=104.36.82.52:4106 , piece_id=QILQAOYJYDWLWKRKYDLYDBUX6X6WOHA2BG75QMB4IROZBGTR5G5A, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.474718086 (341h3m15.43381532s) [noise=true , address=77.90.31.11:4559 , piece_id=RX7BM6LE6BYSL6JFA2U7CY6DVWXWYA23JBBZKDS6CEOBQHQ5XSGA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.604673687 (341h3m15.563770933s) [noise=true , address=156.146.43.225:4462 , piece_id=VHXVL73TI3VG7AT4OADKANNMC2IYAJPZGMOMD566BCUIJZ6JCIRQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.610512983 (341h3m15.569610216s) [noise=true , address=77.90.31.21:4887 , piece_id=UEFRB4XBZEWGHBWRZZQK4REMCTNG2CJHQBBITMWBDNNSNGFWZHLQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.615806994 (341h3m15.574904242s) [noise=true , address=77.90.31.18:4828 , piece_id=BSAHX5S5HUZX7Y7ZXPM7T23KV2PDMJVOYTCMFF3R2OH4HDHWY2QQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.615842156 (341h3m15.574939406s) [seg_pos={0 0}, upload=355000]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:28:53.616097159 (341h3m15.575194405s) [noise=true , address=79.127.201.214:4290 , piece_id=7UHTR572JSL6VFIEYAOZ57ZMIXVRT6VD5UY5RUQRQUE7HO5TV7IA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BryZTvcX7p9QuUZZFcaYbbWJwu1TDqmSygFe2rRYXFLpgBbcu): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616261370 (341h3m15.575358616s) [noise=true , address=79.127.220.97:4374 , piece_id=USLVI4RQ5HBW3CB7RTN3PFYT3OI6Y4PW5YLTJ4LLLUYGSXOMX6ZA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1L3VyMxeHVMjber5Eqzq6qPscLnehguJjgNk7qkdSPkh3fF35d): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616423066 (341h3m15.57552031s) [noise=true , address=104.36.82.5:4844 , piece_id=L2NFD3TG4AAQLA4TEUNNOEDZNRPJDRNV36CKNYIMFSA7V6Q3OWXA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616470488 (341h3m15.575567734s) [noise=true , address=77.90.31.10:4525 , piece_id=7RU6FJ4CHGA5FELL4LUBHFDPN7QENJSNH2OK3A7M2INHPZ5NAVDA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127uTYN8tB4A6G4jW2mFpBfp7p2ziDAMYnwJLNUHv4D7f15wZ5r): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616484803 (341h3m15.575582034s) [seg_pos={0 0}, upload=355000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:28:53.616589361 (341h3m15.575686607s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:28:53.616594764 (341h3m15.575692013s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:28:54.330147008 (341h3m16.289244267s) [upload=355000]: Done uploading segments...
Aug 22 22:28:54.330188820 (341h3m16.289286054s) [upload=355000]: Upload finished. err: <nil>
Duration: 2.764243578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.680643606s
FAIL (2025-08-22 22:28:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 22:28:52.292763761 (341h3m14.251861015s) [upload=355000]: Starting upload
Aug 22 22:28:52.292849717 (341h3m14.251946951s) [upload=355000]: Done starting upload
Aug 22 22:28:52.292962301 (341h3m14.25205955s) [upload=355000]: Uploading segments...
Aug 22 22:28:52.293274015 (341h3m14.252371272s) [upload=355000]: Got next segment. Inline: false
Aug 22 22:28:52.293342238 (341h3m14.252439494s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 22:28:52.293349224 (341h3m14.252446479s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 22:28:52.571223777 (341h3m14.530321035s) [seg_pos={0 0}, upload=355000]: Begin upload segment...
Aug 22 22:28:52.571331148 (341h3m14.530428396s) [noise=true , address=104.36.82.40:4948 , piece_id=6LZJGOXEF3GOLRZJQIGPYDX2YWLQA23O75KMHSVXLABIU5D5OCZA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.572355082 (341h3m14.531452349s) [seg_pos={0 0}, upload=355000]: Done begin upload segment.
Aug 22 22:28:52.572422865 (341h3m14.531520121s) [noise=true , address=156.146.43.225:4462 , piece_id=VHXVL73TI3VG7AT4OADKANNMC2IYAJPZGMOMD566BCUIJZ6JCIRQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.572987759 (341h3m14.532085014s) [noise=true , address=45.91.116.13:4177 , piece_id=RMUWHPK35OZURKV7KFOW2VPUFRQHB4JRESYCF7Y6Y2GBFGA6P6QA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573106382 (341h3m14.532203638s) [noise=true , address=104.36.82.11:4120 , piece_id=QKIA762J5TOVP3RHGMQKH42BTUU75XIWNYJ4XNS7QFWG2NBXABWQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573519849 (341h3m14.532617095s) [noise=true , address=104.36.82.5:4844 , piece_id=L2NFD3TG4AAQLA4TEUNNOEDZNRPJDRNV36CKNYIMFSA7V6Q3OWXA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.573866294 (341h3m14.532963544s) [noise=true , address=104.36.82.50:4023 , piece_id=53MHXC2I4I5R2LYSOUXKTBJXS33VDQDJUVRCS5XHJHRJCSCY6DRQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.574545651 (341h3m14.533642901s) [noise=true , address=45.91.116.10:4086 , piece_id=S77CKA6QF7N7Y475674MBNT3322UAACTVS2YQEJP6YOKMZSQLDCA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.574728219 (341h3m14.533825465s) [noise=true , address=77.90.31.21:4887 , piece_id=UEFRB4XBZEWGHBWRZZQK4REMCTNG2CJHQBBITMWBDNNSNGFWZHLQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.575345810 (341h3m14.534443055s) [noise=true , address=79.127.220.97:4374 , piece_id=USLVI4RQ5HBW3CB7RTN3PFYT3OI6Y4PW5YLTJ4LLLUYGSXOMX6ZA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.576072020 (341h3m14.535169273s) [noise=true , address=104.36.82.52:4106 , piece_id=QILQAOYJYDWLWKRKYDLYDBUX6X6WOHA2BG75QMB4IROZBGTR5G5A, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.576563870 (341h3m14.535661129s) [noise=true , address=104.36.82.60:4341 , piece_id=HSVE7XYRPFXFPBHI2GMF55C3DTZGQFEAWDI6XXW3UO32SI5I6E5A, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578098915 (341h3m14.537196176s) [noise=true , address=104.36.82.23:4447 , piece_id=IW2XXNZSDTYJGAIPQGPCKVJ3CPMBM6IAG7ZMHLVEV7ZJAZHYLSNA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578123251 (341h3m14.537220482s) [noise=true , address=104.36.82.13:4190 , piece_id=U6W57ZEALPXXVMQTSNYSRVMVKVVQUVZMRACT7DTBVCXURMR4EAOA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578544540 (341h3m14.537641795s) [noise=true , address=77.90.31.11:4559 , piece_id=RX7BM6LE6BYSL6JFA2U7CY6DVWXWYA23JBBZKDS6CEOBQHQ5XSGA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.578882761 (341h3m14.537980016s) [noise=true , address=77.90.31.18:4828 , piece_id=BSAHX5S5HUZX7Y7ZXPM7T23KV2PDMJVOYTCMFF3R2OH4HDHWY2QQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.580083267 (341h3m14.539180504s) [noise=true , address=77.90.31.10:4525 , piece_id=7RU6FJ4CHGA5FELL4LUBHFDPN7QENJSNH2OK3A7M2INHPZ5NAVDA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.582261285 (341h3m14.541358526s) [noise=true , address=79.127.201.214:4290 , piece_id=7UHTR572JSL6VFIEYAOZ57ZMIXVRT6VD5UY5RUQRQUE7HO5TV7IA, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:52.584663797 (341h3m14.543761047s) [noise=true , address=104.36.82.44:4902 , piece_id=SI4J2RSA55CNWG6XWMJY4VDU2TCLNOZALKO3V7WN5KP5MQRVOZQQ, seg_pos={0 0}, upload=355000]: Uploading piece...
Aug 22 22:28:53.130690470 (341h3m15.089787725s) [upload=355000]: Next returned nil segment
Aug 22 22:28:53.130715136 (341h3m15.089812391s) [upload=355000]: Waiting for error group managing segments...
Aug 22 22:28:53.290477119 (341h3m15.24957436s) [noise=true , address=45.91.116.13:4177 , piece_id=RMUWHPK35OZURKV7KFOW2VPUFRQHB4JRESYCF7Y6Y2GBFGA6P6QA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.311352230 (341h3m15.270449464s) [noise=true , address=104.36.82.44:4902 , piece_id=SI4J2RSA55CNWG6XWMJY4VDU2TCLNOZALKO3V7WN5KP5MQRVOZQQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.336272255 (341h3m15.295369487s) [noise=true , address=104.36.82.11:4120 , piece_id=QKIA762J5TOVP3RHGMQKH42BTUU75XIWNYJ4XNS7QFWG2NBXABWQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.346825886 (341h3m15.305923121s) [noise=true , address=104.36.82.13:4190 , piece_id=U6W57ZEALPXXVMQTSNYSRVMVKVVQUVZMRACT7DTBVCXURMR4EAOA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.349889005 (341h3m15.308986239s) [noise=true , address=104.36.82.23:4447 , piece_id=IW2XXNZSDTYJGAIPQGPCKVJ3CPMBM6IAG7ZMHLVEV7ZJAZHYLSNA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.361874624 (341h3m15.320971855s) [noise=true , address=104.36.82.60:4341 , piece_id=HSVE7XYRPFXFPBHI2GMF55C3DTZGQFEAWDI6XXW3UO32SI5I6E5A, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.365332047 (341h3m15.324429281s) [noise=true , address=104.36.82.50:4023 , piece_id=53MHXC2I4I5R2LYSOUXKTBJXS33VDQDJUVRCS5XHJHRJCSCY6DRQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.386793575 (341h3m15.345890807s) [noise=true , address=104.36.82.40:4948 , piece_id=6LZJGOXEF3GOLRZJQIGPYDX2YWLQA23O75KMHSVXLABIU5D5OCZA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.414649931 (341h3m15.373747166s) [noise=true , address=45.91.116.10:4086 , piece_id=S77CKA6QF7N7Y475674MBNT3322UAACTVS2YQEJP6YOKMZSQLDCA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.419787692 (341h3m15.378884944s) [noise=true , address=104.36.82.52:4106 , piece_id=QILQAOYJYDWLWKRKYDLYDBUX6X6WOHA2BG75QMB4IROZBGTR5G5A, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.474718086 (341h3m15.43381532s) [noise=true , address=77.90.31.11:4559 , piece_id=RX7BM6LE6BYSL6JFA2U7CY6DVWXWYA23JBBZKDS6CEOBQHQ5XSGA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.604673687 (341h3m15.563770933s) [noise=true , address=156.146.43.225:4462 , piece_id=VHXVL73TI3VG7AT4OADKANNMC2IYAJPZGMOMD566BCUIJZ6JCIRQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.610512983 (341h3m15.569610216s) [noise=true , address=77.90.31.21:4887 , piece_id=UEFRB4XBZEWGHBWRZZQK4REMCTNG2CJHQBBITMWBDNNSNGFWZHLQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.615806994 (341h3m15.574904242s) [noise=true , address=77.90.31.18:4828 , piece_id=BSAHX5S5HUZX7Y7ZXPM7T23KV2PDMJVOYTCMFF3R2OH4HDHWY2QQ, seg_pos={0 0}, upload=355000]: Done uploading piece. err: <nil>
Aug 22 22:28:53.615842156 (341h3m15.574939406s) [seg_pos={0 0}, upload=355000]: Segment reached optimal threshold of 14 pieces.
Aug 22 22:28:53.616097159 (341h3m15.575194405s) [noise=true , address=79.127.201.214:4290 , piece_id=7UHTR572JSL6VFIEYAOZ57ZMIXVRT6VD5UY5RUQRQUE7HO5TV7IA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BryZTvcX7p9QuUZZFcaYbbWJwu1TDqmSygFe2rRYXFLpgBbcu): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616261370 (341h3m15.575358616s) [noise=true , address=79.127.220.97:4374 , piece_id=USLVI4RQ5HBW3CB7RTN3PFYT3OI6Y4PW5YLTJ4LLLUYGSXOMX6ZA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1L3VyMxeHVMjber5Eqzq6qPscLnehguJjgNk7qkdSPkh3fF35d): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616423066 (341h3m15.57552031s) [noise=true , address=104.36.82.5:4844 , piece_id=L2NFD3TG4AAQLA4TEUNNOEDZNRPJDRNV36CKNYIMFSA7V6Q3OWXA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616470488 (341h3m15.575567734s) [noise=true , address=77.90.31.10:4525 , piece_id=7RU6FJ4CHGA5FELL4LUBHFDPN7QENJSNH2OK3A7M2INHPZ5NAVDA, seg_pos={0 0}, upload=355000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127uTYN8tB4A6G4jW2mFpBfp7p2ziDAMYnwJLNUHv4D7f15wZ5r): protocol: expected piece hash; context canceled; EOF
Aug 22 22:28:53.616484803 (341h3m15.575582034s) [seg_pos={0 0}, upload=355000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 22:28:53.616589361 (341h3m15.575686607s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 22:28:53.616594764 (341h3m15.575692013s) [upload=355000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 22:28:54.330147008 (341h3m16.289244267s) [upload=355000]: Done uploading segments...
Aug 22 22:28:54.330188820 (341h3m16.289286054s) [upload=355000]: Upload finished. err: <nil>
Duration: 2.68068928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X................X.................................X...X.] duration:
960.229193ms
FAIL (2025-08-22 22:28:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:27:16.415884812 (341h1m38.37498207s) [upload=354973]: Starting upload Aug 22 22:27:16.415988547 (341h1m38.375085803s) [upload=354973]: Done starting upload Aug 22 22:27:16.416121143 (341h1m38.375218388s) [upload=354973]: Uploading segments... Aug 22 22:27:16.416191250 (341h1m38.375288508s) [upload=354973]: Got next segment. Inline: true Aug 22 22:27:16.416197809 (341h1m38.375295063s) [upload=354973]: Waiting for error group managing segments... Aug 22 22:27:16.416265221 (341h1m38.375362475s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:27:16.416271906 (341h1m38.375369161s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:27:16.416276289 (341h1m38.375373539s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:27:16.504938910 (341h1m38.464036165s) [upload=354973]: Done uploading segments... Aug 22 22:27:16.504987336 (341h1m38.464084582s) [upload=354973]: Upload finished. err: metaclient: Too Many Requests
Duration: 960.272514ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X................X.................................X...X] duration:
360.759817ms
FAIL (2025-08-22 22:27:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:27:16.415884812 (341h1m38.37498207s) [upload=354973]: Starting upload Aug 22 22:27:16.415988547 (341h1m38.375085803s) [upload=354973]: Done starting upload Aug 22 22:27:16.416121143 (341h1m38.375218388s) [upload=354973]: Uploading segments... Aug 22 22:27:16.416191250 (341h1m38.375288508s) [upload=354973]: Got next segment. Inline: true Aug 22 22:27:16.416197809 (341h1m38.375295063s) [upload=354973]: Waiting for error group managing segments... Aug 22 22:27:16.416265221 (341h1m38.375362475s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:27:16.416271906 (341h1m38.375369161s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:27:16.416276289 (341h1m38.375373539s) [upload=354973]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:27:16.504938910 (341h1m38.464036165s) [upload=354973]: Done uploading segments... Aug 22 22:27:16.504987336 (341h1m38.464084582s) [upload=354973]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.779139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X................X.................................X...] duration:
848.086198ms
FAIL (2025-08-22 22:26:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:23:52.479347066 (340h58m14.438444311s) [upload=354912]: Starting upload Aug 22 22:23:52.479592463 (340h58m14.438689718s) [upload=354912]: Done starting upload Aug 22 22:23:52.479748226 (340h58m14.438845464s) [upload=354912]: Uploading segments... Aug 22 22:23:52.479812550 (340h58m14.438909805s) [upload=354912]: Got next segment. Inline: true Aug 22 22:23:52.479818864 (340h58m14.438916112s) [upload=354912]: Waiting for error group managing segments... Aug 22 22:23:52.479876937 (340h58m14.438974182s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:23:52.479882817 (340h58m14.438980062s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:23:52.479886399 (340h58m14.438983646s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:23:52.602389220 (340h58m14.561486475s) [upload=354912]: Done uploading segments... Aug 22 22:23:52.602412826 (340h58m14.561510081s) [upload=354912]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.12165ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X................X.................................X..] duration:
955.016542ms
FAIL (2025-08-22 22:25:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:23:52.479347066 (340h58m14.438444311s) [upload=354912]: Starting upload Aug 22 22:23:52.479592463 (340h58m14.438689718s) [upload=354912]: Done starting upload Aug 22 22:23:52.479748226 (340h58m14.438845464s) [upload=354912]: Uploading segments... Aug 22 22:23:52.479812550 (340h58m14.438909805s) [upload=354912]: Got next segment. Inline: true Aug 22 22:23:52.479818864 (340h58m14.438916112s) [upload=354912]: Waiting for error group managing segments... Aug 22 22:23:52.479876937 (340h58m14.438974182s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:23:52.479882817 (340h58m14.438980062s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:23:52.479886399 (340h58m14.438983646s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:23:52.602389220 (340h58m14.561486475s) [upload=354912]: Done uploading segments... Aug 22 22:23:52.602412826 (340h58m14.561510081s) [upload=354912]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.053509ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X................X.................................X.] duration:
865.740795ms
FAIL (2025-08-22 22:24:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:23:52.479347066 (340h58m14.438444311s) [upload=354912]: Starting upload Aug 22 22:23:52.479592463 (340h58m14.438689718s) [upload=354912]: Done starting upload Aug 22 22:23:52.479748226 (340h58m14.438845464s) [upload=354912]: Uploading segments... Aug 22 22:23:52.479812550 (340h58m14.438909805s) [upload=354912]: Got next segment. Inline: true Aug 22 22:23:52.479818864 (340h58m14.438916112s) [upload=354912]: Waiting for error group managing segments... Aug 22 22:23:52.479876937 (340h58m14.438974182s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:23:52.479882817 (340h58m14.438980062s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:23:52.479886399 (340h58m14.438983646s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:23:52.602389220 (340h58m14.561486475s) [upload=354912]: Done uploading segments... Aug 22 22:23:52.602412826 (340h58m14.561510081s) [upload=354912]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.771371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X................X.................................X] duration:
397.262226ms
FAIL (2025-08-22 22:23:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 22:23:52.479347066 (340h58m14.438444311s) [upload=354912]: Starting upload Aug 22 22:23:52.479592463 (340h58m14.438689718s) [upload=354912]: Done starting upload Aug 22 22:23:52.479748226 (340h58m14.438845464s) [upload=354912]: Uploading segments... Aug 22 22:23:52.479812550 (340h58m14.438909805s) [upload=354912]: Got next segment. Inline: true Aug 22 22:23:52.479818864 (340h58m14.438916112s) [upload=354912]: Waiting for error group managing segments... Aug 22 22:23:52.479876937 (340h58m14.438974182s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 22:23:52.479882817 (340h58m14.438980062s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 22:23:52.479886399 (340h58m14.438983646s) [upload=354912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 22:23:52.602389220 (340h58m14.561486475s) [upload=354912]: Done uploading segments... Aug 22 22:23:52.602412826 (340h58m14.561510081s) [upload=354912]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.292687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X................X.................................] duration:
865.293095ms
FAIL (2025-08-22 22:23:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.326372ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X................X................................] duration:
1.14329566s
FAIL (2025-08-22 22:23:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.143346807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X................X...............................] duration:
1.086780115s
FAIL (2025-08-22 22:22:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.086806294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X................X..............................] duration:
1.278430496s
FAIL (2025-08-22 22:21:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.278480347s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X................X.............................] duration:
886.906901ms
FAIL (2025-08-22 22:21:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.942391ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.............X................X............................] duration:
1.159261456s
FAIL (2025-08-22 22:20:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.15929202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.............X................X...........................] duration:
1.057912966s
FAIL (2025-08-22 22:19:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.058002067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.............X................X..........................] duration:
988.977813ms
FAIL (2025-08-22 22:19:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 989.013993ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.............X................X.........................] duration:
1.092158548s
FAIL (2025-08-22 22:18:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.092257284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.............X................X........................] duration:
1.032187971s
FAIL (2025-08-22 22:18:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.032224618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.............X................X.......................] duration:
890.659961ms
FAIL (2025-08-22 22:17:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.690172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.............X................X......................] duration:
853.02031ms
FAIL (2025-08-22 22:17:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.049561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.............X................X.....................] duration:
1.118699223s
FAIL (2025-08-22 22:16:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.118733369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.............X................X....................] duration:
1.088827859s
FAIL (2025-08-22 22:15:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.088858497s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.............X................X...................] duration:
956.252786ms
FAIL (2025-08-22 22:15:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 956.304271ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.728269217s
FAIL (2025-08-22 22:15:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.728299037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.515484464s
FAIL (2025-08-22 22:14:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.515511683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.96632835s
FAIL (2025-08-22 22:14:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.966356741s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.............X................X..................] duration:
1.239759354s
FAIL (2025-08-22 22:14:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.239795807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.606990904s
FAIL (2025-08-22 22:13:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.607022386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.............X................X.................] duration:
1.06743596s
FAIL (2025-08-22 22:13:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.06748292s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.443629441s
FAIL (2025-08-22 22:12:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.443665222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.............X................X................] duration:
945.071319ms
FAIL (2025-08-22 22:11:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 945.112386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.588481398s
FAIL (2025-08-22 22:11:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.588517897s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.............X................X...............] duration:
1.176488319s
FAIL (2025-08-22 22:10:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.176519732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.96802389s
FAIL (2025-08-22 22:10:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.968058871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.73207231s
FAIL (2025-08-22 22:09:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.732102706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.............X................X..............] duration:
2.21674476s
FAIL (2025-08-22 22:09:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.216779679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.............X................X.............] duration:
1.109080749s
FAIL (2025-08-22 22:09:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.109116211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.649541029s
FAIL (2025-08-22 22:08:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.649576426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.............X................X............] duration:
1.133434974s
FAIL (2025-08-22 22:08:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.133471411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.553526645s
FAIL (2025-08-22 22:07:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.553565994s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.............X................X...........] duration:
937.287033ms
FAIL (2025-08-22 22:07:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 937.316992ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.626943355s
FAIL (2025-08-22 22:06:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.626986973s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.............X................X..........] duration:
1.247188265s
FAIL (2025-08-22 22:06:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.247222613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.606797547s
FAIL (2025-08-22 22:05:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.606834206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.............X................X.........] duration:
886.392398ms
FAIL (2025-08-22 22:05:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.427502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.............X................X........] duration:
856.181781ms
FAIL (2025-08-22 22:04:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.219842ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.606542282s
FAIL (2025-08-22 22:04:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.606574065s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.............X................X.......] duration:
876.885292ms
FAIL (2025-08-22 22:04:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 21:59:24.884450993 (340h33m46.843548301s) [upload=354481]: Starting upload Aug 22 21:59:24.884509020 (340h33m46.843606265s) [upload=354481]: Done starting upload Aug 22 21:59:24.884593931 (340h33m46.843691178s) [upload=354481]: Uploading segments... Aug 22 21:59:24.884651625 (340h33m46.84374888s) [upload=354481]: Got next segment. Inline: true Aug 22 21:59:24.884657705 (340h33m46.843754954s) [upload=354481]: Waiting for error group managing segments... Aug 22 21:59:24.884707365 (340h33m46.84380461s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 21:59:24.884714062 (340h33m46.843811329s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 21:59:24.884719153 (340h33m46.843816398s) [upload=354481]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 21:59:24.973720891 (340h33m46.932818137s) [upload=354481]: Done uploading segments... Aug 22 21:59:24.973752756 (340h33m46.932849996s) [upload=354481]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.917101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.713730385s
FAIL (2025-08-22 22:03:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 22 21:25:34.773303579 (339h59m56.732400833s) [upload=353912]: Starting upload
Aug 22 21:25:34.773382024 (339h59m56.732479272s) [upload=353912]: Done starting upload
Aug 22 21:25:34.773485548 (339h59m56.732582785s) [upload=353912]: Uploading segments...
Aug 22 21:25:34.773878819 (339h59m56.73297605s) [upload=353912]: Got next segment. Inline: false
Aug 22 21:25:34.773967037 (339h59m56.733064282s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 21:25:34.773972513 (339h59m56.733069757s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 21:25:35.007109974 (339h59m56.966207226s) [seg_pos={0 0}, upload=353912]: Begin upload segment...
Aug 22 21:25:35.007192073 (339h59m56.966289326s) [seg_pos={0 0}, upload=353912]: Done begin upload segment.
Aug 22 21:25:35.007209178 (339h59m56.966306432s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007221097 (339h59m56.966318361s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.007704877 (339h59m56.966802122s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008015156 (339h59m56.967112403s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008270388 (339h59m56.967367639s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008327628 (339h59m56.967424873s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008628465 (339h59m56.967725713s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.008685129 (339h59m56.967782375s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009084406 (339h59m56.968181657s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009533217 (339h59m56.968630467s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.009964190 (339h59m56.969061436s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010315189 (339h59m56.969412438s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010605785 (339h59m56.969703034s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.010771644 (339h59m56.96986889s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011270431 (339h59m56.970367679s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011513709 (339h59m56.970610962s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.011883515 (339h59m56.970980762s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.012188259 (339h59m56.971285504s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Uploading piece...
Aug 22 21:25:35.588272932 (339h59m57.547370167s) [upload=353912]: Next returned nil segment
Aug 22 21:25:35.588293295 (339h59m57.54739054s) [upload=353912]: Waiting for error group managing segments...
Aug 22 21:25:35.744251753 (339h59m57.703348998s) [noise=true , address=104.36.82.20:4455 , piece_id=NFMP7ZVMU3LNIVDMDNIGZ5CICGIZE2P4M2YJ6ONUMVDO6A7NSPFQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.753218593 (339h59m57.712315831s) [noise=true , address=104.36.82.10:4087 , piece_id=6WDQMA32BOJXHCQSV2LWDJ5OHDBTNBBQN5PRPEILWGEV2EAC6NBA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.768824800 (339h59m57.727922046s) [noise=true , address=104.36.82.46:4481 , piece_id=KXTX4K7SIWYR724H4XDV2ZJUY2FXX5GFKORTP56CFWIJCL3LPEFA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.769090018 (339h59m57.728187253s) [noise=true , address=104.36.82.44:4874 , piece_id=C75OZTRKXUQSJDHZ2G6EPVCCGFRXNIO57R3PVL536H7OIEANVYQQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.773861302 (339h59m57.732958555s) [noise=true , address=104.36.82.45:4918 , piece_id=UUEFB5DOEXXEI4AWFHLISLTDFU6RAUMVJOXYDFVGRNKYRCXUTFRA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.783726671 (339h59m57.74282391s) [noise=true , address=77.90.31.18:4809 , piece_id=G5E4S7ITNPDGGSD4GYOTKFIW2T4YGQJYUSO7OMYNVVWLO6OOZRPA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.786669667 (339h59m57.745766906s) [noise=true , address=104.36.82.15:4281 , piece_id=EBIREOBMG7RDPPQFO5P4JRMTTZL77CKNVRXFYEEP2QMYLNRVXLCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.796697331 (339h59m57.755794563s) [noise=true , address=45.91.116.11:4140 , piece_id=WARESGO5TWW5UEVGJ46GVEMUKGTB7G3LWM26MKIM3WBBF77F47LQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.798652635 (339h59m57.757749866s) [noise=true , address=77.90.31.21:4904 , piece_id=5FEBSV5LOBV4CMXGXC5Q7XX7GVTVSICZMO43Z7IV4XMHNLINJ5BA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.801851722 (339h59m57.760948958s) [noise=true , address=104.36.82.40:4949 , piece_id=WK7UGTXULLUFR23PHMJTX7IKAGPIQGXVLWYXEKJ6L7Y7EI2RAHWA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.814842774 (339h59m57.773940008s) [noise=true , address=104.36.82.42:4823 , piece_id=M2ZBYEZUXYLUXLYUUFNKH4LXRJVY4SBZMUKJI6WOVLRRH6ATZY2A, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.816907294 (339h59m57.776004541s) [noise=true , address=104.36.82.35:4583 , piece_id=3HQMJRDR3D24XOJXSBAIUNYLVNIMAYGPMLLQK3Q3KMFRCVXVQAUQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.820892967 (339h59m57.779990207s) [noise=true , address=104.36.82.9:4040 , piece_id=L4A2XZSJFV66UUK7W53O6Q5HI6KPVDKH2X4GWNRZS6VZYBHE2D5Q, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840879594 (339h59m57.799976849s) [noise=true , address=104.36.82.5:4865 , piece_id=PFGLHZOEZCXLOLZPIPXULKOPTMSWBKC425223KEQP4H4YVR6PZOQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: <nil>
Aug 22 21:25:35.840915405 (339h59m57.800012702s) [seg_pos={0 0}, upload=353912]: Segment reached optimal threshold of 14 pieces.
Aug 22 21:25:35.841074353 (339h59m57.800171591s) [noise=true , address=79.127.201.215:4355 , piece_id=UJNRIHYH7PWNHDQX2VFIQCTO7B3IHWVAXE7FXETFHT4RCVNAAYJA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841223463 (339h59m57.800320713s) [noise=true , address=104.36.82.13:4210 , piece_id=XJLEOVZGB4FU4WZNSVTXE3JLIKS7UQEAPSBMKB3GPKT73LPRVDCA, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ybrcx8SPgyEsJWq2P1KYaTwTj5v5BfENKNEZZxaKRvKvuqTiL): protocol: expected piece hash; context canceled; EOF
Aug 22 21:25:35.841299416 (339h59m57.800396654s) [noise=true , address=104.36.82.60:4338 , piece_id=GCOVDHSJQGWOZ2CRY3HMAPBF2ZIYKAKYQ2NFK5XTCAI25K2OE2NQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55464->104.36.82.60:4338: use of closed network connection
Aug 22 21:25:35.841328902 (339h59m57.800426156s) [noise=true , address=45.91.116.13:4164 , piece_id=5JGF7ZO4DG5MDJJWMVFFRSHSCKJN6CDWQGK3CXPQW7XSUYPKGHTQ, seg_pos={0 0}, upload=353912]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sy3iQ81wRjoqXs8RhuZW677SBDn4VP6tw14hbozoWenFfgdqu): protocol: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38656->45.91.116.13:4164: use of closed network connection
Aug 22 21:25:35.841371346 (339h59m57.800468602s) [seg_pos={0 0}, upload=353912]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 22 21:25:35.841476463 (339h59m57.800573718s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 22 21:25:35.841482671 (339h59m57.800579929s) [upload=353912]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 21:25:36.168467971 (339h59m58.127565238s) [upload=353912]: Done uploading segments...
Aug 22 21:25:36.168486835 (339h59m58.127584074s) [upload=353912]: Upload finished. err: <nil>
Duration: 2.713756625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|