Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.103134093s FAIL (2025-08-17 13:02:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== B44CK3IWJO53O7XSYRQJBQJNI45Q, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.623419406 (211h36m19.582516657s) [noise=true , address=77.90.31.13:4637 , piece_id=4OPXZPLU2L4QH3NUIUC5JS5NYB3I6ZSFVKADB5E2SLUJCXDD6B6A, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.623533790 (211h36m19.582631038s) [noise=true , address=104.36.82.9:4025 , piece_id=BMLWKFKZIK24UVH4LWU2VE6FI6TKEYNXWDQHX3WNZASZ6VZ5HPUQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.624033710 (211h36m19.583130962s) [noise=true , address=104.36.82.44:4881 , piece_id=G5U3T2EYWCGEGOVMVCIKUR2DVFRRAQERJWZ4FW3K4LDP7MW73DCQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.624118255 (211h36m19.583215504s) [noise=true , address=77.90.31.11:4564 , piece_id=FUIZGXDBGA3X7SNVYDHSUQ2MIEWR2BNIJSN6A7IQ55GYOPSLD6MA, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.624372020 (211h36m19.583469268s) [noise=true , address=77.90.31.18:4838 , piece_id=35G7C4FET4EG6XJFFOXKGG72L7KGBA7Q54OKGBC4PY7RJBWCLIFQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.624633062 (211h36m19.583730309s) [noise=true , address=79.127.219.48:4101 , piece_id=32QEI5TD6R2DZ5QGFQUWVYZUV76E7DSMUDIEAWGTEQDN7TFHFKIA, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.624707435 (211h36m19.583804686s) [noise=true , address=104.36.82.39:4729 , piece_id=XX3FFXEXIVPQWT5AVGE3DWUCDJVDHVWOMVGJCSX2NKJ255VUGWTQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.625038108 (211h36m19.584135358s) [noise=true , address=104.36.82.23:4446 , piece_id=LHHOKUTW7YSPN24WBWG22M6O2DFA7SZ3X333NA2R7KOFPS7BTE7A, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.625101897 (211h36m19.584199152s) [noise=true , address=77.90.31.16:4767 , piece_id=PIPL7OXEWMXWU7XKK7LGIWUFIOPWMK5PLU66SHMB7DBB636ODS2A, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.625506022 (211h36m19.584603281s) [noise=true , address=104.36.82.60:4363 , piece_id=4KSHJL34SV4XAMJC42HGP7S7OZ2U53F2UEL6OUX4GXAGSDYXSR7A, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.625516326 (211h36m19.584613583s) [noise=true , address=79.127.201.215:4355 , piece_id=M6MF632EDVIG72ZRRIE25TFJRTATJQN4BMN7C7QK6O3G5Z7IWZUQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.626006725 (211h36m19.585103978s) [noise=true , address=79.127.219.48:4099 , piece_id=QYNTLLY2APZH5AYGBGLC3GZ6HNLRDG3K7T2Z4AC4P76QERQHUAOA, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.626048859 (211h36m19.585146113s) [noise=true , address=77.90.31.15:4703 , piece_id=ROOD44TR3NOU7FXMXJ6Z5CA43V6P4HGB3TGD7FOYE7TAK3J7MORQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.626460515 (211h36m19.585557766s) [noise=true , address=45.91.116.6:4005 , piece_id=VOS36B46Q46TYWP4FRMLDEQP4YVFGSGEA6QGPP2QZMPKNASF3KSQ, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.626496978 (211h36m19.585594226s) [noise=true , address=104.36.82.2:4756 , piece_id=4WO5IL2CEVQPL5OKIVFX6IEWPORM3I45MFHQFUYH5X7CJ72IBL5A, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:57.630363378 (211h36m19.589460617s) [noise=true , address=104.36.82.4:4820 , piece_id=FWMJQKJXZ2DH3UMQOW3D6U7BV6QQF6HA56OGQBZ633YA25HE5K6Q, seg_pos={0 0}, upload=220311]: Uploading piece... Aug 17 13:01:58.194492332 (211h36m20.153589582s) [upload=220311]: Next returned nil segment Aug 17 13:01:58.194513191 (211h36m20.153610447s) [upload=220311]: Waiting for error group managing segments... Aug 17 13:01:58.355507641 (211h36m20.31460488s) [noise=true , address=45.91.116.6:4005 , piece_id=VOS36B46Q46TYWP4FRMLDEQP4YVFGSGEA6QGPP2QZMPKNASF3KSQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.363223838 (211h36m20.322321075s) [noise=true , address=77.90.31.11:4564 , piece_id=FUIZGXDBGA3X7SNVYDHSUQ2MIEWR2BNIJSN6A7IQ55GYOPSLD6MA, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.382479767 (211h36m20.341577005s) [noise=true , address=77.90.31.15:4703 , piece_id=ROOD44TR3NOU7FXMXJ6Z5CA43V6P4HGB3TGD7FOYE7TAK3J7MORQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.384245183 (211h36m20.343342429s) [noise=true , address=79.127.219.48:4101 , piece_id=32QEI5TD6R2DZ5QGFQUWVYZUV76E7DSMUDIEAWGTEQDN7TFHFKIA, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.388534050 (211h36m20.347631298s) [noise=true , address=77.90.31.18:4838 , piece_id=35G7C4FET4EG6XJFFOXKGG72L7KGBA7Q54OKGBC4PY7RJBWCLIFQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.393459708 (211h36m20.352556947s) [noise=true , address=79.127.219.48:4099 , piece_id=QYNTLLY2APZH5AYGBGLC3GZ6HNLRDG3K7T2Z4AC4P76QERQHUAOA, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.480747290 (211h36m20.439844544s) [noise=true , address=77.90.31.13:4637 , piece_id=4OPXZPLU2L4QH3NUIUC5JS5NYB3I6ZSFVKADB5E2SLUJCXDD6B6A, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.614536319 (211h36m20.573633567s) [noise=true , address=77.90.31.16:4767 , piece_id=PIPL7OXEWMXWU7XKK7LGIWUFIOPWMK5PLU66SHMB7DBB636ODS2A, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:01:58.697603102 (211h36m20.656700341s) [noise=true , address=79.127.201.215:4355 , piece_id=M6MF632EDVIG72ZRRIE25TFJRTATJQN4BMN7C7QK6O3G5Z7IWZUQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: <nil> Aug 17 13:02:57.152129322 (211h37m19.111226568s) [noise=true , address=104.36.82.44:4881 , piece_id=G5U3T2EYWCGEGOVMVCIKUR2DVFRRAQERJWZ4FW3K4LDP7MW73DCQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp, address:104.36.82.44:4881): protocol: rpc: dial tcp 104.36.82.44:4881: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152217611 (211h37m19.111314857s) [noise=true , address=104.36.82.4:4820 , piece_id=FWMJQKJXZ2DH3UMQOW3D6U7BV6QQF6HA56OGQBZ633YA25HE5K6Q, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: rpc: dial tcp 104.36.82.4:4820: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152321500 (211h37m19.111418745s) [noise=true , address=104.36.82.2:4756 , piece_id=4WO5IL2CEVQPL5OKIVFX6IEWPORM3I45MFHQFUYH5X7CJ72IBL5A, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1Pow7VVb1PRDBvHjEcS4bfnh3276S313jiGawszkhaJ582pDqQ, address:104.36.82.2:4756): protocol: write tcp 139.59.144.22:59504->104.36.82.2:4756: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152337685 (211h37m19.111434976s) [noise=true , address=104.36.82.5:4850 , piece_id=GLZSXEP37SMKKZZRCZGI3MTE42HY2AFCDGPFUB6WYQSF3LCJMMJA, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1obTuzA1eVY69zki5vcH4cUjgZJzXnbKaj17TLjCLhDhLi7ZEi, address:104.36.82.5:4850): protocol: rpc: dial tcp 104.36.82.5:4850: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152392986 (211h37m19.111490236s) [noise=true , address=104.36.82.60:4363 , piece_id=4KSHJL34SV4XAMJC42HGP7S7OZ2U53F2UEL6OUX4GXAGSDYXSR7A, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1endke3P5J92vFytHPiVczH5VcuHDSXyvd4qK9kFNhkQh8MhL7, address:104.36.82.60:4363): protocol: rpc: dial tcp 104.36.82.60:4363: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152430464 (211h37m19.111527711s) [noise=true , address=104.36.82.39:4729 , piece_id=XX3FFXEXIVPQWT5AVGE3DWUCDJVDHVWOMVGJCSX2NKJ255VUGWTQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:12ruoUvv6Q9UoRJwugnxbUREY1rjuCipHFtteYbwg5HYCHDXQ3L, address:104.36.82.39:4729): protocol: rpc: dial tcp 104.36.82.39:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152496025 (211h37m19.111593272s) [noise=true , address=104.36.82.23:4446 , piece_id=LHHOKUTW7YSPN24WBWG22M6O2DFA7SZ3X333NA2R7KOFPS7BTE7A, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:104.36.82.23:4446): protocol: rpc: dial tcp 104.36.82.23:4446: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152504202 (211h37m19.111601453s) [noise=true , address=104.36.82.9:4025 , piece_id=BMLWKFKZIK24UVH4LWU2VE6FI6TKEYNXWDQHX3WNZASZ6VZ5HPUQ, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1244zx11aa7W2RGE7w1qeLfsHLxQ6f8tLJeNcxssa68QywFbX1R, address:104.36.82.9:4025): protocol: rpc: dial tcp 104.36.82.9:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152516738 (211h37m19.111613976s) [noise=true , address=104.36.82.17:4361 , piece_id=6U5SMK2675Y35RXUDSVDOX5HB44CK3IWJO53O7XSYRQJBQJNI45Q, seg_pos={0 0}, upload=220311]: Done uploading piece. err: ecclient: upload failed (node:1H34KhE8VwBXA9y9RcjKvYmuqfDPCuokR5bRFnmbAJT9dgz9gU, address:104.36.82.17:4361): protocol: rpc: dial tcp 104.36.82.17:4361: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:57.152548239 (211h37m19.111645485s) [seg_pos={0 0}, upload=220311]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Aug 17 13:02:57.252850339 (211h37m19.211947576s) [upload=220311]: Done uploading segments... Aug 17 13:02:57.252878559 (211h37m19.211975805s) [upload=220311]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 1m0.103162891s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X.....X..........X...........................] duration: 801.614489ms FAIL (2025-08-17 13:02:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 801.709392ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X......X...X.........................................X] duration: 1m0.102775628s FAIL (2025-08-17 13:02:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== Aug 17 13:01:50.440225141 (211h36m12.399322386s) [upload=220308]: Starting upload Aug 17 13:01:50.440274589 (211h36m12.399371841s) [upload=220308]: Done starting upload Aug 17 13:01:50.440575793 (211h36m12.399673039s) [upload=220308]: Uploading segments... Aug 17 13:01:50.440631810 (211h36m12.399729064s) [upload=220308]: Got next segment. Inline: false Aug 17 13:01:50.440680884 (211h36m12.399778138s) [upload=220308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 13:01:50.440688013 (211h36m12.399785262s) [upload=220308]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 13:01:50.675874166 (211h36m12.634971439s) [seg_pos={0 0}, upload=220308]: Begin upload segment... Aug 17 13:01:50.675952607 (211h36m12.635049858s) [seg_pos={0 0}, upload=220308]: Done begin upload segment. Aug 17 13:01:50.676238843 (211h36m12.635336096s) [noise=true , address=104.36.82.35:4593 , piece_id=EAXZHKUM4ZTQQY3RJYGOB3PBCU7JA4THVY5BUVJPWK5ZGGY44A6Q, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.676374869 (211h36m12.635472122s) [noise=true , address=79.127.219.47:4057 , piece_id=NAMDUN4F4DOQBGNYUIKIUN3R5BDW45LCDI5GM4MEV6HNKCKOBZSQ, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.676907567 (211h36m12.63600482s) [noise=true , address=104.36.82.59:4332 , piece_id=EYG2G2M5EPW3CAM7OIPATEPEUEQX3ZGR6N6TECA7TVE7CKARVTWA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.678439873 (211h36m12.637537127s) [noise=true , address=104.36.82.38:4711 , piece_id=BBGSYAYMTGAIZTWYLM7QZG2URKMOWNQWT7O5UPEB4D3WXGTM54YA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.678896421 (211h36m12.637993672s) [noise=true , address=104.36.82.58:4269 , piece_id=4I7VF6ZEPQEPI4NYQFTECLDW6PSUHTJIH6MFN5OYFPU6XUPGROCA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.679018181 (211h36m12.638115436s) [noise=true , address=79.127.201.214:4311 , piece_id=XZQ27ZSOGUCX556SBWD2YAN4B4A3YV7JAHQIACO7WAIAGKXPIFIA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.679392690 (211h36m12.638489946s) [noise=true , address=77.90.31.10:4539 , piece_id=3WPCJS55VRPUAMYGGVAHLR72MBYEGCFLZWI55SN2QDOOWXFDXN4A, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.679552027 (211h36m12.638649278s) [noise=true , address=77.90.31.14:4668 , piece_id=46C4IRJZAIPM32HAIP4WTEDEFCRY3ER6B5PXFXR6FPHAO7GN5FXA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.679985450 (211h36m12.639082701s) [noise=true , address=104.36.82.11:4133 , piece_id=TUBBMV2SVJR6V2CWIS3Y26VBJOZUTDKLIW66AHZIU77LFY4YCPRA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.680138721 (211h36m12.639235971s) [noise=true , address=77.90.31.19:4873 , piece_id=UZW3MJLD6PBKSXUUHZVAQD3SIPXHI3OUYMP4GIZF4WOFZWAUGMYA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.680435136 (211h36m12.639532392s) [noise=true , address=79.127.201.215:4345 , piece_id=ZUSCQISAUR26K3JRQ7X75X2M4HI73GOEZ5OLDITR2ZAGQBBFKUYA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.680582248 (211h36m12.639679497s) [noise=true , address=104.36.82.5:4872 , piece_id=OUMNUEV7Q7LXLZBZCQE3CRMXPYPQTEO2SF66SK4KHJBZBULTYWHQ, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.680950048 (211h36m12.6400473s) [noise=true , address=104.36.82.60:4364 , piece_id=SVMWLOCICVYQLCSSENDHLCVZWHGWV5D3F3DQWDHRXI7LB5XOLWCA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.681253324 (211h36m12.64035056s) [noise=true , address=104.36.82.23:4475 , piece_id=NFYD4YIQTAZNOGKV363UGLMDZHNEJZ7EWAAVIAGP7WP34VLCNQCQ, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.681526988 (211h36m12.640624233s) [noise=true , address=45.91.116.12:4258 , piece_id=NWSOH3P6N4WGCIYNZHEKEIGC62VFRDRQKIKUBX3MWCJ4EEK7UGWQ, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.681776079 (211h36m12.640873333s) [noise=true , address=77.90.31.16:4752 , piece_id=I2B3GLW6UHWKXAAF2RRKK2IUTS5SDZZ65NEAWXLVONUR62QBGQNA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.682070467 (211h36m12.641167724s) [noise=true , address=77.90.31.15:4715 , piece_id=BY4JR6NEJYEDJSHIIYN2TMKMCVEDKTLWGFTJIMUQACQXECUSTYLQ, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:50.682381829 (211h36m12.641479075s) [noise=true , address=66.23.193.175:4560 , piece_id=7SK35CDF35USIJY6CCOGLIEIPL2WONNC4MLH7ZGQHRTOVG2H3RBA, seg_pos={0 0}, upload=220308]: Uploading piece... Aug 17 13:01:51.243253137 (211h36m13.202350383s) [upload=220308]: Next returned nil segment Aug 17 13:01:51.243269825 (211h36m13.202367073s) [upload=220308]: Waiting for error group managing segments... Aug 17 13:01:51.402249723 (211h36m13.361346957s) [noise=true , address=77.90.31.16:4752 , piece_id=I2B3GLW6UHWKXAAF2RRKK2IUTS5SDZZ65NEAWXLVONUR62QBGQNA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.402884846 (211h36m13.361982091s) [noise=true , address=45.91.116.12:4258 , piece_id=NWSOH3P6N4WGCIYNZHEKEIGC62VFRDRQKIKUBX3MWCJ4EEK7UGWQ, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.461727457 (211h36m13.420824703s) [noise=true , address=77.90.31.19:4873 , piece_id=UZW3MJLD6PBKSXUUHZVAQD3SIPXHI3OUYMP4GIZF4WOFZWAUGMYA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.466636742 (211h36m13.425733976s) [noise=true , address=77.90.31.14:4668 , piece_id=46C4IRJZAIPM32HAIP4WTEDEFCRY3ER6B5PXFXR6FPHAO7GN5FXA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.471173514 (211h36m13.430270756s) [noise=true , address=79.127.219.47:4057 , piece_id=NAMDUN4F4DOQBGNYUIKIUN3R5BDW45LCDI5GM4MEV6HNKCKOBZSQ, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.552885736 (211h36m13.511982972s) [noise=true , address=77.90.31.15:4715 , piece_id=BY4JR6NEJYEDJSHIIYN2TMKMCVEDKTLWGFTJIMUQACQXECUSTYLQ, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.648554970 (211h36m13.607652214s) [noise=true , address=79.127.201.214:4311 , piece_id=XZQ27ZSOGUCX556SBWD2YAN4B4A3YV7JAHQIACO7WAIAGKXPIFIA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.760194119 (211h36m13.71929135s) [noise=true , address=79.127.201.215:4345 , piece_id=ZUSCQISAUR26K3JRQ7X75X2M4HI73GOEZ5OLDITR2ZAGQBBFKUYA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:51.935379341 (211h36m13.894476579s) [noise=true , address=66.23.193.175:4560 , piece_id=7SK35CDF35USIJY6CCOGLIEIPL2WONNC4MLH7ZGQHRTOVG2H3RBA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:01:52.074446083 (211h36m14.033543315s) [noise=true , address=77.90.31.10:4539 , piece_id=3WPCJS55VRPUAMYGGVAHLR72MBYEGCFLZWI55SN2QDOOWXFDXN4A, seg_pos={0 0}, upload=220308]: Done uploading piece. err: <nil> Aug 17 13:02:50.172590251 (211h37m12.1316875s) [noise=true , address=104.36.82.38:4711 , piece_id=BBGSYAYMTGAIZTWYLM7QZG2URKMOWNQWT7O5UPEB4D3WXGTM54YA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12hpgtWXaoVC18JQaeCK21b7N7B78aYGU8csoEjCv5FLkuciQmM, address:104.36.82.38:4711): protocol: rpc: dial tcp 104.36.82.38:4711: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172670716 (211h37m12.131767963s) [noise=true , address=104.36.82.35:4593 , piece_id=EAXZHKUM4ZTQQY3RJYGOB3PBCU7JA4THVY5BUVJPWK5ZGGY44A6Q, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12Q7uKA1U2EqaMAdCJ9ADpVj9XB9StQwxpdpVkUvrPHgmcoiHxg, address:104.36.82.35:4593): protocol: write tcp 139.59.144.22:40410->104.36.82.35:4593: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172726521 (211h37m12.131823765s) [noise=true , address=104.36.82.5:4872 , piece_id=OUMNUEV7Q7LXLZBZCQE3CRMXPYPQTEO2SF66SK4KHJBZBULTYWHQ, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi, address:104.36.82.5:4872): protocol: rpc: dial tcp 104.36.82.5:4872: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172778528 (211h37m12.131875766s) [noise=true , address=104.36.82.59:4332 , piece_id=EYG2G2M5EPW3CAM7OIPATEPEUEQX3ZGR6N6TECA7TVE7CKARVTWA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ, address:104.36.82.59:4332): protocol: write tcp 139.59.144.22:55614->104.36.82.59:4332: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172815847 (211h37m12.131913093s) [noise=true , address=104.36.82.11:4133 , piece_id=TUBBMV2SVJR6V2CWIS3Y26VBJOZUTDKLIW66AHZIU77LFY4YCPRA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12G5pngZWYQ2abKHEpM7Pa6YeCQ1LotX4qswbqHUwAy9H7a9Ym2, address:104.36.82.11:4133): protocol: rpc: dial tcp 104.36.82.11:4133: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172875993 (211h37m12.131973229s) [noise=true , address=104.36.82.58:4269 , piece_id=4I7VF6ZEPQEPI4NYQFTECLDW6PSUHTJIH6MFN5OYFPU6XUPGROCA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:104.36.82.58:4269): protocol: write tcp 139.59.144.22:34162->104.36.82.58:4269: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172958655 (211h37m12.13205589s) [noise=true , address=104.36.82.23:4475 , piece_id=NFYD4YIQTAZNOGKV363UGLMDZHNEJZ7EWAAVIAGP7WP34VLCNQCQ, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12UYjE6PEB9gZKwTKcnx23ykF4jDMJzLQoKmiFiejWew5mirdCj, address:104.36.82.23:4475): protocol: write tcp 139.59.144.22:42512->104.36.82.23:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.172972229 (211h37m12.132069484s) [noise=true , address=104.36.82.60:4364 , piece_id=SVMWLOCICVYQLCSSENDHLCVZWHGWV5D3F3DQWDHRXI7LB5XOLWCA, seg_pos={0 0}, upload=220308]: Done uploading piece. err: ecclient: upload failed (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk, address:104.36.82.60:4364): protocol: rpc: dial tcp 104.36.82.60:4364: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 17 13:02:50.173039532 (211h37m12.132136788s) [seg_pos={0 0}, upload=220308]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Aug 17 13:02:50.272631872 (211h37m12.231729111s) [upload=220308]: Done uploading segments... Aug 17 13:02:50.272662135 (211h37m12.231759373s) [upload=220308]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 1m0.102803377s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.....X..........X..........................] duration: 1.063972449s FAIL (2025-08-17 13:01:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.064000359s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X......X...X.........................................] duration: 2.687204673s FAIL (2025-08-17 13:01:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.687245451s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.....X..........X.........................] duration: 855.924985ms FAIL (2025-08-17 13:00:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.95321ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.......X......X...X........................................] duration: 3.043690321s FAIL (2025-08-17 13:00:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 3.043741571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.....X..........X........................] duration: 1.214346465s FAIL (2025-08-17 13:00:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.214384571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.......X......X...X.......................................] duration: 2.641317484s FAIL (2025-08-17 12:59:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.641420543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.....X..........X.......................] duration: 1.115656955s FAIL (2025-08-17 12:59:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.115675256s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.......X......X...X......................................] duration: 2.68660258s FAIL (2025-08-17 12:59:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.686632989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.....X..........X......................] duration: 999.915915ms FAIL (2025-08-17 12:58:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 999.953519ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.......X......X...X.....................................] duration: 2.518176793s FAIL (2025-08-17 12:58:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.518288207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.....X..........X.....................] duration: 844.850318ms FAIL (2025-08-17 12:58:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 844.878194ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.......X......X...X....................................] duration: 2.581960955s FAIL (2025-08-17 12:57:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.581993352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.....X..........X....................] duration: 860.74848ms FAIL (2025-08-17 12:57:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 860.779756ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.....X..........X...................] duration: 895.413634ms FAIL (2025-08-17 12:57:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 895.452962ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.....X..........X..................] duration: 835.742542ms FAIL (2025-08-17 12:56:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 835.776228ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.......X......X...X...................................] duration: 2.70351318s FAIL (2025-08-17 12:56:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.703553712s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X........................X.....X..........X.................] duration: 1.323480439s FAIL (2025-08-17 12:56:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.323510509s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.......X......X...X..................................] duration: 2.456020106s FAIL (2025-08-17 12:55:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.456054095s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X........................X.....X..........X................] duration: 891.959569ms FAIL (2025-08-17 12:55:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 892.005072ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X........................X.....X..........X...............] duration: 883.114922ms FAIL (2025-08-17 12:55:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 883.180331ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.......X......X...X.................................] duration: 2.463875966s FAIL (2025-08-17 12:54:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.463907663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X........................X.....X..........X..............] duration: 1.011243664s FAIL (2025-08-17 12:54:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.011302222s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.......X......X...X................................] duration: 2.565969379s FAIL (2025-08-17 12:53:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.566012773s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X........................X.....X..........X.............] duration: 861.798101ms FAIL (2025-08-17 12:53:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.849586ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.......X......X...X...............................] duration: 2.662972475s FAIL (2025-08-17 12:53:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.662998702s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X........................X.....X..........X............] duration: 845.50688ms FAIL (2025-08-17 12:53:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 845.54153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.........X.......X......X...X..............................] duration: 2.416000416s FAIL (2025-08-17 12:52:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.416038113s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.........X.......X......X...X.............................] duration: 2.723862128s FAIL (2025-08-17 12:52:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.723932924s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X........................X.....X..........X...........] duration: 834.095749ms FAIL (2025-08-17 12:52:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 834.148044ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.........X.......X......X...X............................] duration: 2.495829967s FAIL (2025-08-17 12:52:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.495861187s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X........................X.....X..........X..........] duration: 838.754153ms FAIL (2025-08-17 12:52:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 838.785368ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.........X.......X......X...X...........................] duration: 2.611986226s FAIL (2025-08-17 12:51:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.61201501s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X........................X.....X..........X.........] duration: 1.105288356s FAIL (2025-08-17 12:51:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.105323334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.........X.......X......X...X..........................] duration: 2.585303969s FAIL (2025-08-17 12:50:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.585327156s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X........................X.....X..........X........] duration: 835.5266ms FAIL (2025-08-17 12:50:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 835.575134ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.........X.......X......X...X.........................] duration: 2.583993595s FAIL (2025-08-17 12:49:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.584026785s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X........................X.....X..........X.......] duration: 831.423728ms FAIL (2025-08-17 12:49:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 831.454407ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.........X.......X......X...X........................] duration: 2.445383298s FAIL (2025-08-17 12:49:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.445418261s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X........................X.....X..........X......] duration: 843.324596ms FAIL (2025-08-17 12:48:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 843.35589ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.........X.......X......X...X.......................] duration: 2.488413205s FAIL (2025-08-17 12:48:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.48846514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X........................X.....X..........X.....] duration: 910.55326ms FAIL (2025-08-17 12:48:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 910.669296ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.........X.......X......X...X......................] duration: 2.479460485s FAIL (2025-08-17 12:47:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.479481149s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X........................X.....X..........X....] duration: 855.643228ms FAIL (2025-08-17 12:47:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.688347ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X........X.........X.......X......X...X.....................] duration: 2.577886147s FAIL (2025-08-17 12:46:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.577917634s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X........................X.....X..........X...] duration: 968.352396ms FAIL (2025-08-17 12:46:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 968.387414ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X........X.........X.......X......X...X....................] duration: 2.525315168s FAIL (2025-08-17 12:46:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 17 12:31:40.966200489 (211h6m2.925297737s) [upload=219791]: Starting upload Aug 17 12:31:40.966273244 (211h6m2.925370495s) [upload=219791]: Done starting upload Aug 17 12:31:40.966356801 (211h6m2.925454034s) [upload=219791]: Uploading segments... Aug 17 12:31:40.966642287 (211h6m2.925739532s) [upload=219791]: Got next segment. Inline: false Aug 17 12:31:40.966685541 (211h6m2.925782776s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:31:40.966694101 (211h6m2.925791345s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 17 12:31:41.697815399 (211h6m3.656912711s) [seg_pos={0 0}, upload=219791]: Begin upload segment... Aug 17 12:31:41.697875454 (211h6m3.6569727s) [seg_pos={0 0}, upload=219791]: Done begin upload segment. Aug 17 12:31:41.697900316 (211h6m3.656997565s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.697947785 (211h6m3.657045041s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698335757 (211h6m3.657433003s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698536710 (211h6m3.657633981s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698645866 (211h6m3.657743111s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.698921226 (211h6m3.658018473s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699071965 (211h6m3.65816922s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699199597 (211h6m3.658296842s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699513818 (211h6m3.658611122s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699559316 (211h6m3.658656571s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.699927587 (211h6m3.659024832s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700141460 (211h6m3.659238709s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700220608 (211h6m3.659317854s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700525527 (211h6m3.659622763s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700692451 (211h6m3.659789724s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.700826682 (211h6m3.659923928s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701117953 (211h6m3.6602152s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:41.701383712 (211h6m3.660480958s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Uploading piece... Aug 17 12:31:42.269668422 (211h6m4.22876567s) [upload=219791]: Next returned nil segment Aug 17 12:31:42.269710503 (211h6m4.228807749s) [upload=219791]: Waiting for error group managing segments... Aug 17 12:31:42.429049080 (211h6m4.388146327s) [noise=true , address=45.91.116.11:4130 , piece_id=Z662KXERCUIH4AARMQM5ZZXAGSO3PC3Q6SDRNGBQUDPWWTNCBNXA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.429245735 (211h6m4.388342981s) [noise=true , address=104.36.82.5:4843 , piece_id=DU3TGZQZGEWWXTIUFBC6GWJYFUQGCL6O24TRE6SA3KYQLCENQKNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.443860893 (211h6m4.402958136s) [noise=true , address=104.36.82.58:4297 , piece_id=RD4JOEWK3JULUDZOEXHXJLOANQN4WYDRMNV7ZNJSQXX3MT25E36A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.446269793 (211h6m4.40536703s) [noise=true , address=104.36.82.17:4343 , piece_id=OHETXA4RLRB6YWTFVL23YGR5GL2MLL45LFVAMJ3FYCFZ64W46GWA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.447069348 (211h6m4.406166594s) [noise=true , address=104.36.82.10:4101 , piece_id=FPETIRC6P7JNCAGYPIQ4ZNLQU2WYHHYMYY7BXD63HTHTSIYUB45A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.448300606 (211h6m4.407397845s) [noise=true , address=104.36.82.9:4025 , piece_id=FDAADTB5J4VHYLTZX654MGMPN5BCXFX45YGXIPLMAEUFZH34RQCA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450290447 (211h6m4.409387687s) [noise=true , address=104.36.82.2:4734 , piece_id=7I47WSGKBUXHO2UUKKUPINOWDREJFOB3UYCE7NTDOMWAFTH4YO2Q, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.450935771 (211h6m4.410033012s) [noise=true , address=104.36.82.11:4138 , piece_id=HRLDPYYWPVEUYHSHMPOA2O277OVJ2LLXISBXGAR5H5G2XI2CHORA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.455548511 (211h6m4.414645748s) [noise=true , address=104.36.82.23:4475 , piece_id=72OWUMTKM7X3KCXOAFPOHA4E6OZPPW4J3HVNQZYW2DQ6RS7VQ7UQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463572883 (211h6m4.42267015s) [noise=true , address=79.127.219.48:4078 , piece_id=7TSPLBB4X4TPHZSIZWC3B3EJIFUYIFNQGWMTONK4NQ5USFB5GVTA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.463831595 (211h6m4.422928845s) [noise=true , address=104.36.82.60:4341 , piece_id=BNVRYHCVQRNIRCVGM5OBHNWQXUWULG4KPAQ5QNIL26Y346UDZYBQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.471861404 (211h6m4.430958664s) [noise=true , address=104.36.82.44:4876 , piece_id=SPOJLU2FJN547P6XFLMUKFN6GDRWWWNH54GU6PQBSEMK7KW2XU7A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.480661171 (211h6m4.439758417s) [noise=true , address=45.91.116.7:4042 , piece_id=JFODNW3WGNHERYR64G2LPJJNJMEPQVRB2DRCQS7LOWVZSX5DLZJA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553145903 (211h6m4.512243138s) [noise=true , address=77.90.31.11:4585 , piece_id=CJ3SQCGHEXMDZCKXGMLWMDWZKFXK442YRKUHOJZHEKEUJI26XYNA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: <nil> Aug 17 12:31:42.553217176 (211h6m4.512314425s) [seg_pos={0 0}, upload=219791]: Segment reached optimal threshold of 14 pieces. Aug 17 12:31:42.553437979 (211h6m4.512535227s) [noise=true , address=79.127.220.101:4069 , piece_id=CVQTMOX2TIHS2ETDT2ZD43BSVX7ONNTIFXTYKALCFRONQRULDP2A, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CKVYwS7uoSGkffmG2vvEPP8DeiTKqpdfjYdiqrijD6YvpyNeL): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553538398 (211h6m4.512635634s) [noise=true , address=156.146.43.225:4455 , piece_id=PFUKXZD5Z3MW3J7ULJUMYOK2OYPCG7GTOAXXVSQXIBYHDHQUSVVQ, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vY6RULcLQ41fLp7gWvy9mNoSh9VUtu2M8rLTHxQG1T69REqDq): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553638240 (211h6m4.512735489s) [noise=true , address=104.36.82.18:4369 , piece_id=4ZY526AFVBTWVPN4IXFN5UQ5K3HGUAJDDYCDBZLEADFZUBCE3LFA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nwygPHyRJEZkjCoSZJTVhXDKLHc7AonVMzKMht6ppwZwhcGCT): protocol: expected piece hash; context canceled; EOF Aug 17 12:31:42.553725555 (211h6m4.512822802s) [noise=true , address=66.23.193.175:4563 , piece_id=47AZHP2Y6L5KVTUEACS5RLZBLIFZMGLYZKRP2AVDPIR66PSXNTMA, seg_pos={0 0}, upload=219791]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38010->66.23.193.175:4563: use of closed network connection Aug 17 12:31:42.553764423 (211h6m4.51286167s) [seg_pos={0 0}, upload=219791]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 17 12:31:42.553889717 (211h6m4.512987027s) [upload=219791]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 17 12:31:42.553896460 (211h6m4.512993707s) [upload=219791]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:31:42.952281857 (211h6m4.911379138s) [upload=219791]: Done uploading segments... Aug 17 12:31:42.952324113 (211h6m4.911421362s) [upload=219791]: Upload finished. err: <nil> Duration: 2.525422248s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X........................X.....X..........X..] duration: 989.629876ms FAIL (2025-08-17 12:45:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:44:05.807945806 (211h18m27.767043054s) [upload=219997]: Starting upload Aug 17 12:44:05.808007298 (211h18m27.767104543s) [upload=219997]: Done starting upload Aug 17 12:44:05.808069319 (211h18m27.767166565s) [upload=219997]: Uploading segments... Aug 17 12:44:05.808111949 (211h18m27.767209203s) [upload=219997]: Got next segment. Inline: true Aug 17 12:44:05.808116742 (211h18m27.767213988s) [upload=219997]: Waiting for error group managing segments... Aug 17 12:44:05.808161604 (211h18m27.767258849s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 17 12:44:05.808166647 (211h18m27.767263893s) [upload=219997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 17 12:44:05.808170333 (211h18m27.767267578s) [upload=219997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 17 12:44:05.896561884 (211h18m27.85565914s) [upload=219997]: Done uploading segments... Aug 17 12:44:05.896585492 (211h18m27.855682741s) [upload=219997]: Upload finished. err: metaclient: Too Many Requests Duration:* 989.658978ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)