Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.X..X..............................X.................] duration:
2.578973402s
FAIL (2025-08-15 01:56:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.579059428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............................X.........] duration:
869.940784ms
FAIL (2025-08-15 01:55:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 870.005162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X..X..............................X................] duration:
2.463193522s
FAIL (2025-08-15 01:55:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.463232343s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............................X........] duration:
912.102663ms
FAIL (2025-08-15 01:54:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 912.150487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............................X.......] duration:
947.218939ms
FAIL (2025-08-15 01:54:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 947.267766ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.X..X..............................X...............] duration:
2.401936254s
FAIL (2025-08-15 01:54:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.401965278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............................X......] duration:
939.277581ms
FAIL (2025-08-15 01:54:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 939.314654ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X........X.X..X..............................X..............] duration:
2.477671909s
FAIL (2025-08-15 01:53:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.477758588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............................X.....] duration:
912.96853ms
FAIL (2025-08-15 01:53:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 913.015772ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............................X....] duration:
932.297314ms
FAIL (2025-08-15 01:52:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 932.338604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X........X.X..X..............................X.............] duration:
2.354338086s
FAIL (2025-08-15 01:52:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.354374808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X........X.X..X..............................X............] duration:
2.485443852s
FAIL (2025-08-15 01:52:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.48547559s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............................X...] duration:
828.268316ms
FAIL (2025-08-15 01:52:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 828.303778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..........................X.............................X..] duration:
1.066543194s
FAIL (2025-08-15 01:51:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 1.066581439s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X........X.X..X..............................X...........] duration:
2.64230972s
FAIL (2025-08-15 01:51:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.642348338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..........................X.............................X.] duration:
825.156054ms
FAIL (2025-08-15 01:50:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 825.194129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X........X.X..X..............................X..........] duration:
3.12891232s
FAIL (2025-08-15 01:49:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 3.128938503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..........................X.............................X] duration:
706.129982ms
FAIL (2025-08-15 01:49:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 15 01:49:14.019373996 (152h23m35.978471231s) [upload=158761]: Starting upload
Aug 15 01:49:14.019429607 (152h23m35.978526852s) [upload=158761]: Done starting upload
Aug 15 01:49:14.019509969 (152h23m35.978607208s) [upload=158761]: Uploading segments...
Aug 15 01:49:14.019549198 (152h23m35.97864645s) [upload=158761]: Got next segment. Inline: true
Aug 15 01:49:14.019555293 (152h23m35.978652541s) [upload=158761]: Waiting for error group managing segments...
Aug 15 01:49:14.019599971 (152h23m35.978697217s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:49:14.019604797 (152h23m35.978702042s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 15 01:49:14.019608513 (152h23m35.97870576s) [upload=158761]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:49:14.167226440 (152h23m36.126323686s) [upload=158761]: Done uploading segments...
Aug 15 01:49:14.167247047 (152h23m36.126344292s) [upload=158761]: Upload finished. err: <nil>
Duration: 706.194473ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X........X.X..X..............................X.........] duration:
2.41136919s
FAIL (2025-08-15 01:48:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.411398532s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..........................X.............................] duration:
974.858483ms
FAIL (2025-08-15 01:48:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 974.894561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..........................X............................] duration:
1.069645509s
FAIL (2025-08-15 01:47:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.069754552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X........X.X..X..............................X........] duration:
2.45947026s
FAIL (2025-08-15 01:47:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.459613039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..........................X...........................] duration:
949.733338ms
FAIL (2025-08-15 01:47:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 949.775998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X........X.X..X..............................X.......] duration:
2.552579981s
FAIL (2025-08-15 01:46:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.552614511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X........X.X..X..............................X......] duration:
2.624714397s
FAIL (2025-08-15 01:46:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.624742895s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..........................X..........................] duration:
895.434236ms
FAIL (2025-08-15 01:46:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 895.479498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X........X.X..X..............................X.....] duration:
2.490340869s
FAIL (2025-08-15 01:45:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.49038918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................X.........................] duration:
859.582766ms
FAIL (2025-08-15 01:45:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.642795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X........X.X..X..............................X....] duration:
2.666932847s
FAIL (2025-08-15 01:44:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.666973116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................X........................] duration:
827.096671ms
FAIL (2025-08-15 01:44:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.141449ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X........X.X..X..............................X...] duration:
2.710068109s
FAIL (2025-08-15 01:43:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.710105649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................X.......................] duration:
899.701812ms
FAIL (2025-08-15 01:43:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 899.731852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X........X.X..X..............................X..] duration:
2.428426295s
FAIL (2025-08-15 01:43:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.428556439s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................X......................] duration:
812.8745ms
FAIL (2025-08-15 01:42:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 812.907193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X........X.X..X..............................X.] duration:
2.386837285s
FAIL (2025-08-15 01:42:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 2.386871634s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X........X.X..X..............................X] duration:
1.83940406s
FAIL (2025-08-15 01:41:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 01:41:46.736506799 (152h16m8.695604053s) [upload=158641]: Starting upload
Aug 15 01:41:46.736571817 (152h16m8.695669063s) [upload=158641]: Done starting upload
Aug 15 01:41:46.736686300 (152h16m8.695783533s) [upload=158641]: Uploading segments...
Aug 15 01:41:46.736960400 (152h16m8.696057647s) [upload=158641]: Got next segment. Inline: false
Aug 15 01:41:46.737008446 (152h16m8.696105698s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:41:46.737014402 (152h16m8.696111647s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:41:46.939633694 (152h16m8.898730943s) [seg_pos={0 0}, upload=158641]: Begin upload segment...
Aug 15 01:41:46.939693925 (152h16m8.898791161s) [seg_pos={0 0}, upload=158641]: Done begin upload segment.
Aug 15 01:41:46.939722628 (152h16m8.898819876s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.939744552 (152h16m8.898841805s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940241755 (152h16m8.899339009s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940255718 (152h16m8.899352965s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940656010 (152h16m8.899753261s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.940676291 (152h16m8.899785968s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941023255 (152h16m8.900120507s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941037168 (152h16m8.900134425s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941411831 (152h16m8.900509085s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941440553 (152h16m8.900537804s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941712976 (152h16m8.900810228s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.941744080 (152h16m8.900841328s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942056386 (152h16m8.901153639s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942107255 (152h16m8.90120451s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942412233 (152h16m8.901509483s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.942486593 (152h16m8.901583847s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943360270 (152h16m8.902457527s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:46.943809224 (152h16m8.902906465s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Uploading piece...
Aug 15 01:41:47.507429932 (152h16m9.466527187s) [upload=158641]: Next returned nil segment
Aug 15 01:41:47.507456310 (152h16m9.466553565s) [upload=158641]: Waiting for error group managing segments...
Aug 15 01:41:47.658029532 (152h16m9.617126778s) [noise=true , address=77.90.31.12:4605 , piece_id=7WY7SL4F5FSA5WDQUSLDGQYTC2IPK5ATK3RW4HSTK6QBDS4EIAZA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.664783738 (152h16m9.623880969s) [noise=true , address=104.36.82.34:4554 , piece_id=LSX3TY3YJVLEUSPA7RTDNWWLVP4KKQI55OIEC4P3QJ6M53OLCBVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.665777952 (152h16m9.624875197s) [noise=true , address=104.36.82.47:4538 , piece_id=Q4WRVXKXA37ZL7CW7SJN52R5HL4FV4B3TGQ6NVQHNIYOT3UCB3VQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.680471377 (152h16m9.639568625s) [noise=true , address=77.90.31.15:4731 , piece_id=YXHKUVCYFT2SBVKGBEKL6V47E7S3IZNTGGYZKNWHZSPREAVJRVRQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.693439068 (152h16m9.652536314s) [noise=true , address=104.36.82.45:4936 , piece_id=4XHH2GIDUZQDZAEFFA64Z44SNV27BDWA77IXUUQOTSHKN3WIQKVQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.699465184 (152h16m9.65856243s) [noise=true , address=104.36.82.62:4422 , piece_id=7NMI625L5C5YAYIHIQSSVYKZFTL34QUZUBMKLS3NRYPBMMXD3U7Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.703535677 (152h16m9.662632924s) [noise=true , address=104.36.82.2:4754 , piece_id=C5IUT4IG3VMHDUICB3ORQUT62RPJF6ULIBLJOEOA2LYB3V4V5VFA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.706762458 (152h16m9.665859711s) [noise=true , address=104.36.82.18:4372 , piece_id=RA32I3RHF4IOWWE2NK7W52PHSOFR3FTRQSZKM4C2LXNRVW3DOULQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.713431322 (152h16m9.67252856s) [noise=true , address=104.36.82.16:4301 , piece_id=6R7Y7GDFBKILJDXTE4LBCBMFEVGMBIUYQQWA64ZQT3WG4O4CCPMQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.714582466 (152h16m9.673679753s) [noise=true , address=77.90.31.21:4898 , piece_id=TFM7XTT33Q7A2HFR66A2DSDDJQAY53MWQJJ6IHZ746SYZ32PEUTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.717562801 (152h16m9.676660039s) [noise=true , address=104.36.82.17:4347 , piece_id=UPXVYSQXPYLHUPLIG2FDQP5L2WPKVRKGDWZ6U7YGO5J7GCMN3KIQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.728034445 (152h16m9.687131682s) [noise=true , address=104.36.82.19:4401 , piece_id=Z43G7BO34EH7HXGCT72WM4FBM5LEPKRCHYPKFVMAIFURQRI66WTA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.774298150 (152h16m9.733395387s) [noise=true , address=77.90.31.19:4865 , piece_id=RN6SSBIKPBN375DEPCVPZ7FEOERSMHXE2S6FQ4436LOOWTNRXY3Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777899475 (152h16m9.736996721s) [noise=true , address=104.36.82.13:4209 , piece_id=PY5262Q4VNGE7WE3PI733NQCBISTU3AEKR4UEYGOI6XL6SUTPAXA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: <nil>
Aug 15 01:41:47.777960145 (152h16m9.737057394s) [seg_pos={0 0}, upload=158641]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:41:47.778142572 (152h16m9.737239804s) [noise=true , address=104.36.82.39:4745 , piece_id=P2DXIWEU2FHLO4MP3SX45QJYXPAQJOUNCRH7GS3QTJTHWR6WXLUA, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ujPZUMvwigdNuqXMzvgaxXdiVQzEkfsSDNQY7BujAnHLHkXks): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778198819 (152h16m9.737296065s) [noise=true , address=104.36.82.59:4322 , piece_id=WNYENB5ND2C53F2OICLMTFFOGJ2IVTGNDKKAGLJUFBQH7BIMQBLQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bELQDDH69yamGywE32K8YhpPbMRVorkpm85ZFuAtb2CD58ZPH): protocol: expected piece hash; context canceled; EOF
Aug 15 01:41:47.778605689 (152h16m9.737702937s) [noise=true , address=66.23.193.175:4560 , piece_id=HV2HFI2DSPKXB5BD5BV6PGUWLPKRWJR2XVS4TNLTOR37MXRXLREQ, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40688->66.23.193.175:4560: use of closed network connection
Aug 15 01:41:47.778894569 (152h16m9.737991816s) [noise=true , address=66.23.193.175:4563 , piece_id=NHHJSSZMDNDBEZOKDINYCG4YQEN3WXAODLQWU6TKFBP4GZVCWV2Q, seg_pos={0 0}, upload=158641]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42536->66.23.193.175:4563: use of closed network connection
Aug 15 01:41:47.778931794 (152h16m9.738029041s) [seg_pos={0 0}, upload=158641]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:41:47.779101018 (152h16m9.738198264s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:41:47.779118187 (152h16m9.738215472s) [upload=158641]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:41:47.994802637 (152h16m9.953899913s) [upload=158641]: Done uploading segments...
Aug 15 01:41:47.994828080 (152h16m9.953925331s) [upload=158641]: Upload finished. err: <nil>
Duration: 1.839427402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................X.....................] duration:
834.656578ms
FAIL (2025-08-15 01:41:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.694793ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X........X.X..X..............................] duration:
2.523805599s
FAIL (2025-08-15 01:40:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.523847418s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..........................X....................] duration:
817.425965ms
FAIL (2025-08-15 01:40:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.472501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X........X.X..X.............................] duration:
2.521254054s
FAIL (2025-08-15 01:40:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.521388338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........................X...................] duration:
833.225104ms
FAIL (2025-08-15 01:39:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.25791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X........X.X..X............................] duration:
2.366128252s
FAIL (2025-08-15 01:39:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.36616121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X........X.X..X...........................] duration:
2.380662366s
FAIL (2025-08-15 01:38:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.380699939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........................X..................] duration:
869.465531ms
FAIL (2025-08-15 01:38:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.506971ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................X........X.X..X..........................] duration:
2.42232754s
FAIL (2025-08-15 01:38:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.422364188s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........................X.................] duration:
811.261366ms
FAIL (2025-08-15 01:38:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.3101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................X........X.X..X.........................] duration:
2.343647851s
FAIL (2025-08-15 01:37:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.343678399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...............X..........................X................] duration:
972.541915ms
FAIL (2025-08-15 01:37:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 972.632357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....................X........X.X..X........................] duration:
2.663667868s
FAIL (2025-08-15 01:36:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 01:18:30.691038466 (151h52m52.650135713s) [upload=158247]: Starting upload
Aug 15 01:18:30.691102633 (151h52m52.650199881s) [upload=158247]: Done starting upload
Aug 15 01:18:30.691334619 (151h52m52.65043191s) [upload=158247]: Uploading segments...
Aug 15 01:18:30.691422899 (151h52m52.650520151s) [upload=158247]: Got next segment. Inline: false
Aug 15 01:18:30.691463108 (151h52m52.650560367s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 01:18:30.691469142 (151h52m52.650566399s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 01:18:30.895859983 (151h52m52.854957239s) [seg_pos={0 0}, upload=158247]: Begin upload segment...
Aug 15 01:18:30.895941542 (151h52m52.855038786s) [seg_pos={0 0}, upload=158247]: Done begin upload segment.
Aug 15 01:18:30.895998660 (151h52m52.855095913s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896498348 (151h52m52.855595592s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896738570 (151h52m52.855835817s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.896979005 (151h52m52.856076253s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897246743 (151h52m52.856343994s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.897592939 (151h52m52.856690195s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898143855 (151h52m52.857241105s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898556075 (151h52m52.857653331s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.898906945 (151h52m52.858004196s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902040443 (151h52m52.861137719s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902479162 (151h52m52.861576407s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.902777664 (151h52m52.861874909s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903096266 (151h52m52.862193512s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903391378 (151h52m52.862488623s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903661598 (151h52m52.862758843s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.903954623 (151h52m52.863051868s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904446472 (151h52m52.863543728s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:30.904790681 (151h52m52.863887928s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Uploading piece...
Aug 15 01:18:31.491056226 (151h52m53.45015348s) [upload=158247]: Next returned nil segment
Aug 15 01:18:31.491084196 (151h52m53.450181453s) [upload=158247]: Waiting for error group managing segments...
Aug 15 01:18:31.638022904 (151h52m53.597120153s) [noise=true , address=104.36.82.19:4436 , piece_id=H5JWVC26JIRXV6GUZ2RWVPJJX2INYF73AU6CZ2WPVQDYLMJF5Z2Q, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.638458132 (151h52m53.597555378s) [noise=true , address=77.90.31.10:4534 , piece_id=QAMGNVEDBHDEQP5KCCXHZTGDUPNUDFR7BTV44QPV5MDCQCCFDOYQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.646393995 (151h52m53.605491244s) [noise=true , address=104.36.82.59:4333 , piece_id=TN6A6HZGB2NIQE2GITQEYVQ562SJXM6U7PNFFFADOY3BLP3KFUSA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.650301687 (151h52m53.609398918s) [noise=true , address=104.36.82.40:4950 , piece_id=PWFPCXB5U4F576FKRDQVOZ6PJGSB2G6XWS2IKP4BTMG6VT3DBGOA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.654561932 (151h52m53.613659177s) [noise=true , address=104.36.82.34:4565 , piece_id=BX3422FOIYIW6I6K4FVBWXL74UI2KF2FCQSIIOGOH7OFQQL2ITCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.655297195 (151h52m53.614394441s) [noise=true , address=104.36.82.44:4876 , piece_id=GNBZOKN3BPNWW3LGWLPKVEVDBAOZNG4BTRRQ27OC5JXBEOCZWMKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.663186102 (151h52m53.622283348s) [noise=true , address=104.36.82.62:4412 , piece_id=RUIBUY5CKXEMB5XFNZKWM32VIKTE6IVNMB7FYGN3ITLILJZX7GMQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.674659510 (151h52m53.633756762s) [noise=true , address=104.36.82.8:4999 , piece_id=J7YVWMJEDWAH3IJIF73KJDZRJ5RK5EDO43G6HLSZSCHMYBUNOJDA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.678052113 (151h52m53.637149359s) [noise=true , address=104.36.82.17:4351 , piece_id=CLNJFDBDJYWYTUDGQC4CLCLCYBIRGCOUNY77OKVCQ3Q6V6BLXUCQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.682764003 (151h52m53.641861256s) [noise=true , address=104.36.82.38:4721 , piece_id=4DOYTVIJFS2PAM425YFU7RH2ETAVB4Y6HOHVG4GLOYWIXDGP6RRQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.685026780 (151h52m53.644124019s) [noise=true , address=104.36.82.35:4608 , piece_id=4UU66DFNTRONJ4JTMPWJ4U2BBMZTXG6E5ZLSZOYJ72AM2OK6CQ7A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.687121369 (151h52m53.646218618s) [noise=true , address=104.36.82.39:4747 , piece_id=VO7UBHDWWWZSCFYME46SHLNAUTNJVLRTBVHS2FIGW2FXDXQNE5QA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.692751512 (151h52m53.651848761s) [noise=true , address=104.36.82.59:4326 , piece_id=JFZJVOYH6P5TUF7RNZQPQHVMAOCGIGV7IZPXVEIOVATMA2YXNB2A, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695359287 (151h52m53.654456526s) [noise=true , address=104.36.82.2:4743 , piece_id=AIEKN3OSWXDBWNABF7ABT74HO75NW2GT3FXZZO6KE7WOPHTCTIEQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: <nil>
Aug 15 01:18:31.695387105 (151h52m53.65448435s) [seg_pos={0 0}, upload=158247]: Segment reached optimal threshold of 14 pieces.
Aug 15 01:18:31.695521062 (151h52m53.654618307s) [noise=true , address=104.36.82.58:4284 , piece_id=6TY47DGD7JEM35UJI2UN62CLD6GVSQDK2QQBTSGVTWN7R3FPREUA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yVGWcQ8mzYzBmFn71nCA6KuQxg7SxNnLiky9dDjrPtBBcAXrb): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695644005 (151h52m53.65474125s) [noise=true , address=104.36.82.3:4769 , piece_id=TBWE7K7GVRTPUPMZDL7DNTI5WAOBGBTJCZK5IZRN567M656DQISQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695703713 (151h52m53.654800967s) [noise=true , address=45.91.116.14:4207 , piece_id=YXNU4DZH4P4ZHKT4CX34ITFB44BUIFO2PBOEQXKCCRWJ25OVSZKA, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faeeA3tF8s8WfxSwt75951poF8ZfeFUsEJNVXP22UeQCiBLT2): protocol: expected piece hash; context canceled; EOF
Aug 15 01:18:31.695740000 (151h52m53.654837236s) [noise=true , address=64.49.13.140:4516 , piece_id=ERTXTWP7SBKOCJR2AFC432YLA3ZNQ7XMMNVER3YYD47B2LKCO5IQ, seg_pos={0 0}, upload=158247]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48442->64.49.13.140:4516: use of closed network connection
Aug 15 01:18:31.695757823 (151h52m53.654855063s) [seg_pos={0 0}, upload=158247]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 01:18:31.695849238 (151h52m53.654946474s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 01:18:31.695868850 (151h52m53.654966099s) [upload=158247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 01:18:31.870542240 (151h52m53.829639495s) [upload=158247]: Done uploading segments...
Aug 15 01:18:31.870587394 (151h52m53.829684642s) [upload=158247]: Upload finished. err: <nil>
Duration: 2.663707219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...............X..........................X...............] duration:
862.251932ms
FAIL (2025-08-15 01:36:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 01:24:46.283409945 (151h59m8.242507194s) [upload=158358]: Starting upload Aug 15 01:24:46.283476086 (151h59m8.242573334s) [upload=158358]: Done starting upload Aug 15 01:24:46.283552825 (151h59m8.242650074s) [upload=158358]: Uploading segments... Aug 15 01:24:46.283693002 (151h59m8.242790259s) [upload=158358]: Got next segment. Inline: true Aug 15 01:24:46.283702006 (151h59m8.242799262s) [upload=158358]: Waiting for error group managing segments... Aug 15 01:24:46.283795401 (151h59m8.242892664s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 01:24:46.283803112 (151h59m8.242900363s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 01:24:46.283827480 (151h59m8.24292473s) [upload=158358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 01:24:46.371866841 (151h59m8.330964088s) [upload=158358]: Done uploading segments... Aug 15 01:24:46.371885870 (151h59m8.330983108s) [upload=158358]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.285457ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|