Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X......X..................X......X......X......X...........] duration:
2.419034622s
FAIL (2025-08-19 11:27:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.4190758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X......................................X.................] duration:
831.733401ms
FAIL (2025-08-19 11:27:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.767193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X.X......X..................X......X......X......X..........] duration:
2.610994766s
FAIL (2025-08-19 11:26:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.611032163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X......................................X................] duration:
1.023933818s
FAIL (2025-08-19 11:26:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.023963754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X.X......X..................X......X......X......X.........] duration:
2.612757521s
FAIL (2025-08-19 11:26:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.612809695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X.X......X..................X......X......X......X........] duration:
2.716423431s
FAIL (2025-08-19 11:25:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.716457546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X......................................X...............] duration:
852.19649ms
FAIL (2025-08-19 11:25:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.24065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X.X......X..................X......X......X......X.......] duration:
2.586990879s
FAIL (2025-08-19 11:24:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.587106831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X......................................X..............] duration:
828.048187ms
FAIL (2025-08-19 11:24:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 828.109409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X.X......X..................X......X......X......X......] duration:
2.872798268s
FAIL (2025-08-19 11:24:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.872909053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X......................................X.............] duration:
883.135746ms
FAIL (2025-08-19 11:24:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.182787ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X.X......X..................X......X......X......X.....] duration:
2.396793212s
FAIL (2025-08-19 11:23:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.396883332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X......................................X............] duration:
880.697715ms
FAIL (2025-08-19 11:23:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.725807ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X......................................X...........] duration:
1.069945563s
FAIL (2025-08-19 11:22:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.069989056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X.X......X..................X......X......X......X....] duration:
2.541932083s
FAIL (2025-08-19 11:22:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.54196546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X......................................X..........] duration:
961.378966ms
FAIL (2025-08-19 11:22:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 961.423143ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......X.X......X..................X......X......X......X...] duration:
2.537951139s
FAIL (2025-08-19 11:21:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.537991243s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X......................................X.........] duration:
1.064258466s
FAIL (2025-08-19 11:21:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.064288472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X......................................X........] duration:
876.02063ms
FAIL (2025-08-19 11:21:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.055531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [........X.X......X..................X......X......X......X..] duration:
2.505135227s
FAIL (2025-08-19 11:21:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.505174438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X......................................X.......] duration:
842.520138ms
FAIL (2025-08-19 11:20:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.558667ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.........X.X......X..................X......X......X......X.] duration:
2.763957949s
FAIL (2025-08-19 11:20:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.764056061s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..........X.X......X..................X......X......X......X] duration:
2.038713669s
FAIL (2025-08-19 11:20:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 11:20:09.416178515 (257h54m31.375275752s) [upload=268514]: Starting upload
Aug 19 11:20:09.416236589 (257h54m31.375333836s) [upload=268514]: Done starting upload
Aug 19 11:20:09.416506893 (257h54m31.375604132s) [upload=268514]: Uploading segments...
Aug 19 11:20:09.416605500 (257h54m31.375702747s) [upload=268514]: Got next segment. Inline: false
Aug 19 11:20:09.416653993 (257h54m31.37575124s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:20:09.416660104 (257h54m31.375757351s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:20:09.617266009 (257h54m31.576363257s) [seg_pos={0 0}, upload=268514]: Begin upload segment...
Aug 19 11:20:09.617342940 (257h54m31.57644019s) [seg_pos={0 0}, upload=268514]: Done begin upload segment.
Aug 19 11:20:09.617395135 (257h54m31.576492381s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618064790 (257h54m31.577162039s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618099201 (257h54m31.57719656s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618512845 (257h54m31.577610103s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618542726 (257h54m31.577639983s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.618950193 (257h54m31.578047442s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619029874 (257h54m31.578127121s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619284380 (257h54m31.578381634s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619472576 (257h54m31.578569828s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619602489 (257h54m31.578699745s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619853432 (257h54m31.578950679s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.619958019 (257h54m31.57905528s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620318475 (257h54m31.579415727s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620349264 (257h54m31.579446527s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620728492 (257h54m31.579825739s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.620773878 (257h54m31.579871133s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621070902 (257h54m31.580168152s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:09.621377007 (257h54m31.580474253s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Uploading piece...
Aug 19 11:20:10.182454139 (257h54m32.141551393s) [upload=268514]: Next returned nil segment
Aug 19 11:20:10.182477623 (257h54m32.14157488s) [upload=268514]: Waiting for error group managing segments...
Aug 19 11:20:10.326163115 (257h54m32.285260364s) [noise=true , address=77.90.31.17:4781 , piece_id=RRHZKC3IUEXPQLNOI5H7PEXE3XULXFLB3RZS5GFJ7TLEKS4C5XHQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.336610186 (257h54m32.295707424s) [noise=true , address=45.91.116.9:4285 , piece_id=CKWGY6FOOVPN2X6BMTNEN2AU4DWCLE5G7F5UQLWIAWF3MM5XGV3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.343305943 (257h54m32.302403182s) [noise=true , address=79.127.219.38:4027 , piece_id=TJQNRZA7XYQQBBH2WQ7UKFQJT2N2ZKR3YTSNAIA4OLZSV462XCBQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.345083295 (257h54m32.304180528s) [noise=true , address=45.91.116.11:4142 , piece_id=TLOTQNQILW3EVAMOPMUX4AYRVCUM7HIPWHVDQIOOKXU52I2OKELQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.346421748 (257h54m32.305518994s) [noise=true , address=104.36.82.23:4452 , piece_id=R5CX4SSLK6LFTVVQVV5FR4A4ABDGZFLHRMWEMYDR5PQC2XTG264A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.348469782 (257h54m32.307567019s) [noise=true , address=77.90.31.12:4624 , piece_id=IARARQ3YQHL76E6ZRCXNIE3VE7VJDIMDW7FOB5RNMI6HXOAGGLYQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.361468418 (257h54m32.320565657s) [noise=true , address=104.36.82.60:4344 , piece_id=G3WIQ56M26LZXRTXAP2KL33IEIAYMIEMOE4J7W4C4D3MJXM57OTQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.362916792 (257h54m32.322014045s) [noise=true , address=104.36.82.18:4368 , piece_id=5G2KJC74X7E7BIOHHPZO4F3ZXBFWQTDWHB5VYBV3C5YDNAPRJ5IA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.363106411 (257h54m32.322203658s) [noise=true , address=104.36.82.3:4769 , piece_id=6RJR2JDGPH2IHHALRJ5IAIRJI3ITOK2EVJQDZBC2EQ45ZNEYSVPQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.439678380 (257h54m32.398775613s) [noise=true , address=77.90.31.13:4650 , piece_id=W45U5R6ZISDKL7YOBSSBPSTHUQHL2H6WUIPFYA45PN7FE5RC6Z2A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.459442143 (257h54m32.418539374s) [noise=true , address=77.90.31.19:4845 , piece_id=NP5TTTEPBWDU4DLH57RV3HS3WMGTNBAITFJOI53V7PWQEXMQF7RA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.480686553 (257h54m32.4397838s) [noise=true , address=77.90.31.10:4533 , piece_id=MQ5Z4AZPOB3IVREZKMH6VA2YRICJLFNKH6EXXRD5HXMRSQNLKFOQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.513571485 (257h54m32.472668727s) [noise=true , address=104.36.82.10:4085 , piece_id=MLSFRY26QHJ4RNEZUUXKYSQ74PNCEUON3XEAL3RFPC6JPW4F2AIQ, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603834703 (257h54m32.562931949s) [noise=true , address=79.127.201.215:4353 , piece_id=2XFMP5BYMRWJOWOJ5XLV65BVXCLMAODL44DRKIG6V5CRSPM4JRRA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: <nil>
Aug 19 11:20:10.603869472 (257h54m32.562966827s) [seg_pos={0 0}, upload=268514]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:20:10.604097014 (257h54m32.56319426s) [noise=true , address=77.90.31.16:4764 , piece_id=JL6P35VXZS6RN4G5BZWPTOKCRPPKHEDSFXQ7XZQMBCSWDOPFTU3A, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ftkFznfF2NSYrtgqUm3hgcyfwaZtWQfh2nDBEawxPh4SecemT): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604245743 (257h54m32.563342979s) [noise=true , address=77.90.31.18:4831 , piece_id=KHEPJRJIHNMFPNZJG3TRKOZ4PP4NUQC3HDGJMJK67YLHWFIMAB2Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 19 11:20:10.604740123 (257h54m32.563837373s) [noise=true , address=66.23.193.175:4556 , piece_id=YBCDO65FSEEQ6XXSWIE7NHTY4YP2PBD5VCCYWDFRMQA5565O4M5Q, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46408->66.23.193.175:4556: use of closed network connection
Aug 19 11:20:10.604761136 (257h54m32.563858377s) [noise=true , address=45.91.116.13:4187 , piece_id=PK2WLKQQYZNBUD6ZURALPRZHJRNWPWZEXYORA32ZKYPLCTLKNTCA, seg_pos={0 0}, upload=268514]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qxNK1SVXKBZJnNpf3iyhtqrBXD7KcRwJDpru1uz8DZQ45gNTJ): protocol: context canceled
Aug 19 11:20:10.604789182 (257h54m32.563886418s) [seg_pos={0 0}, upload=268514]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:20:10.604925703 (257h54m32.564022957s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:20:10.604933539 (257h54m32.56403079s) [upload=268514]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:20:10.823131910 (257h54m32.782229161s) [upload=268514]: Done uploading segments...
Aug 19 11:20:10.823171978 (257h54m32.782269224s) [upload=268514]: Upload finished. err: <nil>
Duration: 2.03881672s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X......................................X......] duration:
1.048120374s
FAIL (2025-08-19 11:19:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.048146267s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X.X......X..................X......X......X......] duration:
2.395988588s
FAIL (2025-08-19 11:19:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.396021773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X......................................X.....] duration:
827.444104ms
FAIL (2025-08-19 11:18:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.470984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............X.X......X..................X......X......X.....] duration:
2.582897325s
FAIL (2025-08-19 11:18:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.582936608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X......................................X....] duration:
988.126662ms
FAIL (2025-08-19 11:17:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 988.163626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............X.X......X..................X......X......X....] duration:
2.579775099s
FAIL (2025-08-19 11:17:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.579806937s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X......................................X...] duration:
821.68162ms
FAIL (2025-08-19 11:17:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.738243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X......................................X..] duration:
818.147982ms
FAIL (2025-08-19 11:16:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.16843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............X.X......X..................X......X......X...] duration:
2.563042718s
FAIL (2025-08-19 11:16:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.563082885s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............X.X......X..................X......X......X..] duration:
2.506284539s
FAIL (2025-08-19 11:16:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.506338487s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X......................................X.] duration:
1.003347518s
FAIL (2025-08-19 11:16:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.003377953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X...............X.X......X..................X......X......X.] duration:
2.629498446s
FAIL (2025-08-19 11:15:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.62952909s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X......................................X] duration:
355.763574ms
FAIL (2025-08-19 11:15:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:14.976100281 (257h49m36.935197526s) [upload=268422]: Starting upload Aug 19 11:15:14.976148229 (257h49m36.935245475s) [upload=268422]: Done starting upload Aug 19 11:15:14.976251114 (257h49m36.935348351s) [upload=268422]: Uploading segments... Aug 19 11:15:14.976300571 (257h49m36.935397825s) [upload=268422]: Got next segment. Inline: true Aug 19 11:15:14.976306110 (257h49m36.935403355s) [upload=268422]: Waiting for error group managing segments... Aug 19 11:15:14.976568916 (257h49m36.935666168s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:14.976577454 (257h49m36.935674705s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:15:14.976581405 (257h49m36.935678652s) [upload=268422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:15:15.063904160 (257h49m37.023001417s) [upload=268422]: Done uploading segments... Aug 19 11:15:15.063930983 (257h49m37.02302823s) [upload=268422]: Upload finished. err: metaclient: Too Many Requests
Duration: 356.243768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X...............X.X......X..................X......X......X] duration:
371.831158ms
FAIL (2025-08-19 11:15:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:15:01.812205744 (257h49m23.771303013s) [upload=268419]: Starting upload Aug 19 11:15:01.812325450 (257h49m23.771422707s) [upload=268419]: Done starting upload Aug 19 11:15:01.812613318 (257h49m23.771710568s) [upload=268419]: Uploading segments... Aug 19 11:15:01.813171873 (257h49m23.772269126s) [upload=268419]: Got next segment. Inline: false Aug 19 11:15:01.813317276 (257h49m23.772414535s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:15:01.813325907 (257h49m23.772423165s) [upload=268419]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:15:01.907550517 (257h49m23.866647778s) [upload=268419]: Next segment err: metaclient: Too Many Requests Aug 19 11:15:01.907580251 (257h49m23.866677485s) [upload=268419]: Done uploading segments... Aug 19 11:15:01.907602389 (257h49m23.86669966s) [upload=268419]: Upload finished. err: metaclient: Too Many Requests
Duration: 371.866328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
854.55134ms
FAIL (2025-08-19 11:14:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 854.588789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.083033524s
FAIL (2025-08-19 11:14:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.083070008s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X...............X.X......X..................X......X......] duration:
2.549667174s
FAIL (2025-08-19 11:14:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.549712725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
906.505854ms
FAIL (2025-08-19 11:14:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 906.544137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X...............X.X......X..................X......X.....] duration:
3.094976197s
FAIL (2025-08-19 11:14:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.095013368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....X...............X.X......X..................X......X....] duration:
2.430403185s
FAIL (2025-08-19 11:13:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.430437912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.297303327s
FAIL (2025-08-19 11:13:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.297337919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X...............X.X......X..................X......X...] duration:
2.57388855s
FAIL (2025-08-19 11:13:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.573923141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
820.099125ms
FAIL (2025-08-19 11:12:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 820.143742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
819.904696ms
FAIL (2025-08-19 11:12:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 819.93371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X...............X.X......X..................X......X..] duration:
2.455815643s
FAIL (2025-08-19 11:11:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.455854796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X...............X.X......X..................X......X.] duration:
2.730403903s
FAIL (2025-08-19 11:11:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:10:51.470993612 (257h45m13.430090865s) [upload=268344]: Starting upload Aug 19 11:10:51.471083367 (257h45m13.430180616s) [upload=268344]: Done starting upload Aug 19 11:10:51.471245567 (257h45m13.430342815s) [upload=268344]: Uploading segments... Aug 19 11:10:51.471744203 (257h45m13.430841458s) [upload=268344]: Got next segment. Inline: false Aug 19 11:10:51.471829005 (257h45m13.430926261s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:10:51.471836423 (257h45m13.430933679s) [upload=268344]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:10:51.560345053 (257h45m13.519442308s) [upload=268344]: Next segment err: metaclient: Too Many Requests Aug 19 11:10:51.560511127 (257h45m13.519608385s) [upload=268344]: Done uploading segments... Aug 19 11:10:51.560537038 (257h45m13.519634291s) [upload=268344]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.730457662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
868.881411ms
FAIL (2025-08-19 11:11:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 10:48:14.642614181 (257h22m36.601711482s) [upload=267949]: Starting upload Aug 19 10:48:14.642695394 (257h22m36.601792638s) [upload=267949]: Done starting upload Aug 19 10:48:14.642765896 (257h22m36.601863146s) [upload=267949]: Uploading segments... Aug 19 10:48:14.642889411 (257h22m36.601986664s) [upload=267949]: Got next segment. Inline: true Aug 19 10:48:14.642896484 (257h22m36.601993741s) [upload=267949]: Waiting for error group managing segments... Aug 19 10:48:14.642969011 (257h22m36.602066267s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 10:48:14.642976423 (257h22m36.602073675s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 10:48:14.642981486 (257h22m36.602078739s) [upload=267949]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 10:48:14.731092887 (257h22m36.690190136s) [upload=267949]: Done uploading segments... Aug 19 10:48:14.731115063 (257h22m36.690212312s) [upload=267949]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.947708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|