Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
862.499317ms
FAIL (2025-08-12 01:56:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.528695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.336859878s
FAIL (2025-08-12 01:56:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.336896071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
869.497826ms
FAIL (2025-08-12 01:56:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.528521ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.408492398s
FAIL (2025-08-12 01:56:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.408553107s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.52248452s
FAIL (2025-08-12 01:55:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.522528364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
866.443111ms
FAIL (2025-08-12 01:55:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.508662ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.478211143s
FAIL (2025-08-12 01:54:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.47824683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.009762195s
FAIL (2025-08-12 01:54:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.009800855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.846600181s
FAIL (2025-08-12 01:53:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.846631195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
905.371801ms
FAIL (2025-08-12 01:53:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 905.425238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
867.741225ms
FAIL (2025-08-12 01:53:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 867.801323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.389371046s
FAIL (2025-08-12 01:52:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.389406545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.440852633s
FAIL (2025-08-12 01:52:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.440891717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.084201419s
FAIL (2025-08-12 01:52:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.084423532s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.630562832s
FAIL (2025-08-12 01:51:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.630640529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
915.690634ms
FAIL (2025-08-12 01:51:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.78171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.561812063s
FAIL (2025-08-12 01:50:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.561835867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
877.268412ms
FAIL (2025-08-12 01:50:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.373753ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.4692911s
FAIL (2025-08-12 01:49:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.469335212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.358552657s
FAIL (2025-08-12 01:49:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.358587012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
830.93518ms
FAIL (2025-08-12 01:49:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 830.989567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.426266393s
FAIL (2025-08-12 01:48:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.426298102s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
860.073123ms
FAIL (2025-08-12 01:48:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 860.174046ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
874.847151ms
FAIL (2025-08-12 01:47:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.876145ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.869134715s
FAIL (2025-08-12 01:47:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 2.869166003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.689916557s
FAIL (2025-08-12 01:47:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:47:07.009162442 (80h21m28.968259686s) [upload=83758]: Starting upload
Aug 12 01:47:07.009280241 (80h21m28.968377488s) [upload=83758]: Done starting upload
Aug 12 01:47:07.009391958 (80h21m28.968489206s) [upload=83758]: Uploading segments...
Aug 12 01:47:07.009960537 (80h21m28.969057848s) [upload=83758]: Got next segment. Inline: false
Aug 12 01:47:07.010067342 (80h21m28.969164591s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:47:07.010075295 (80h21m28.969172552s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:47:07.208146096 (80h21m29.167243341s) [seg_pos={0 0}, upload=83758]: Begin upload segment...
Aug 12 01:47:07.208381468 (80h21m29.167478721s) [seg_pos={0 0}, upload=83758]: Done begin upload segment.
Aug 12 01:47:07.208440063 (80h21m29.167537316s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208471707 (80h21m29.167568954s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.208914929 (80h21m29.168012174s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209019133 (80h21m29.168116381s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209251249 (80h21m29.168348494s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209426366 (80h21m29.168523615s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209555721 (80h21m29.168652969s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209814829 (80h21m29.168912076s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.209847617 (80h21m29.168944862s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210193042 (80h21m29.169290286s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.210220816 (80h21m29.169318063s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.211677393 (80h21m29.170774646s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.213316991 (80h21m29.17241424s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.214423227 (80h21m29.173520477s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.215726308 (80h21m29.174823563s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216322823 (80h21m29.175420073s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.216787400 (80h21m29.175884635s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.225169188 (80h21m29.184266438s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Uploading piece...
Aug 12 01:47:07.783440422 (80h21m29.742537667s) [upload=83758]: Next returned nil segment
Aug 12 01:47:07.783461582 (80h21m29.74255883s) [upload=83758]: Waiting for error group managing segments...
Aug 12 01:47:07.962125812 (80h21m29.92122305s) [noise=true , address=77.90.31.10:4544 , piece_id=6DL6B6S4JD25BDGF33BF4QQ6HIUYNL4K7AH4LJB6BSGPR46ILIRA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963387071 (80h21m29.922484394s) [noise=true , address=104.36.82.46:4482 , piece_id=3AED53BGMUDCVAQWUD726TKXEBWFFYZT6U4EJ56S6U2QNFMWJUEQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.963628035 (80h21m29.922725273s) [noise=true , address=104.36.82.38:4720 , piece_id=OPBVKHJD54U4ZJY5SXLRTVNC7K63NFJPQF6JTUJSMMGQGFQU4UXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.965732882 (80h21m29.924830114s) [noise=true , address=104.36.82.13:4217 , piece_id=EUO2OWNCJYLVCHXWFNLB5NR7ZRWF2K2ML653CW4BGE2XQL2VSCJA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971064047 (80h21m29.93016128s) [noise=true , address=104.36.82.5:4865 , piece_id=7CFGNGSBA7PO6G5GEDQYRBHZIX5JLFA6TU3CYVDTNVH46GVAYRBQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.971389325 (80h21m29.930486563s) [noise=true , address=104.36.82.61:4408 , piece_id=UQ2WP32VZQRCVNLF5MYMGCPRFDY4QAGK3I3ALVYULBLMTBMETKXA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978562190 (80h21m29.937659471s) [noise=true , address=104.36.82.37:4685 , piece_id=J574POBPLAN2U2OIAWQAWSO6TFS4DGSYHPQTWGMQZ24WNHV4CR2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.978599385 (80h21m29.937696623s) [noise=true , address=104.36.82.43:4848 , piece_id=E3QIUNSZRXZ4AFNZL7O3VNOGB6XJHVCXOCLGTDIEIADJIW7PQG6A, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.983070063 (80h21m29.942167319s) [noise=true , address=104.36.82.60:4346 , piece_id=OIFOUQX23PPSRNOY23XGJO46Y5PKRFWDYD7WHD23LZ3QI2VFEUBA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.989163846 (80h21m29.948261113s) [noise=true , address=104.36.82.3:4782 , piece_id=T2NCY5MAOYNUCMKNU62G3HU6CJT7SZIFCBW3BRSSWI4BK3GNDH2Q, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.990574602 (80h21m29.949671855s) [noise=true , address=104.36.82.23:4457 , piece_id=ZRJEHKWIKVH5XDE7CZV3WQLH6D6U76MNOGN6DVFB3EKMAINFS2BA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:07.991263156 (80h21m29.950360411s) [noise=true , address=104.36.82.62:4431 , piece_id=VS25AZQ3AX6DH4XRBR2CD7AHFVVO23N36JK6FT4CCTBXWZU43MEA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.004282305 (80h21m29.963379654s) [noise=true , address=104.36.82.59:4316 , piece_id=F4JBIIMQPSQ3T6SFNBYBW7W6OQ4DSY4EAAVX7YFLVLWVJG37L7SQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034692509 (80h21m29.993789754s) [noise=true , address=104.36.82.9:4016 , piece_id=4FWUYJUM67Q5X4B42Y4CKYWMETQJDH7DCEOXOHKXW6T3K72MNYNA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: <nil>
Aug 12 01:47:08.034723340 (80h21m29.993820586s) [seg_pos={0 0}, upload=83758]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:47:08.034851471 (80h21m29.993948706s) [noise=true , address=104.36.82.9:4010 , piece_id=TZ5HZBINU74CCGFFYPUB4VYH3XOUIA5RISC4NG56HT2SCJVRYHMQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034865206 (80h21m29.993962452s) [noise=true , address=79.127.201.215:4339 , piece_id=HNMC2TCKHSVTHFHAZZ55YZUYQDYZ37UTFWBS5M3LSHCBSXMP6QVQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vNk3EQzMohodu6TGCkt9UGUunnNUyXpMQCXak64JGicyc4Xyo): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.034941891 (80h21m29.994039128s) [noise=true , address=79.127.220.97:4383 , piece_id=AUGFLSV3CJGD5IR7XCP2RRC5Y6TP5CE55PPL74RMOI4YLOBOMOGQ, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1niBoronEiRN4sEauoTUiEqPLZKiRHC36bW4uztZTTnKPhkTuu): protocol: expected piece hash; context canceled; EOF
Aug 12 01:47:08.035021867 (80h21m29.994119104s) [noise=true , address=79.127.205.234:4596 , piece_id=DERLYHWIAK3ZNGAEN6UOZWKKGM6UTG4SPLZMAELOS7UJP5ALQUSA, seg_pos={0 0}, upload=83758]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DkRaBq5soAH37CFyhaLRYt1Kcvcvb9twG3bQDhjm3cdXtgoWT): protocol: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51534->79.127.205.234:4596: use of closed network connection
Aug 12 01:47:08.035060606 (80h21m29.994157838s) [seg_pos={0 0}, upload=83758]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:47:08.035144314 (80h21m29.994241546s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:47:08.035149144 (80h21m29.994246375s) [upload=83758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:47:08.219234188 (80h21m30.178331423s) [upload=83758]: Done uploading segments...
Aug 12 01:47:08.219267414 (80h21m30.17836466s) [upload=83758]: Upload finished. err: <nil>
Duration: 1.68994848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.117179273s
FAIL (2025-08-12 01:46:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.117213797s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
873.250609ms
FAIL (2025-08-12 01:45:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.290229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
866.235924ms
FAIL (2025-08-12 01:44:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.274825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.005942433s
FAIL (2025-08-12 01:43:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.005971966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
845.09925ms
FAIL (2025-08-12 01:43:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.128371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
950.921018ms
FAIL (2025-08-12 01:42:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 950.95611ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
857.192298ms
FAIL (2025-08-12 01:42:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.285663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.016772411s
FAIL (2025-08-12 01:41:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.01680547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
392.707736ms
FAIL (2025-08-12 01:40:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:40:24.819901246 (80h14m46.778998494s) [upload=83647]: Starting upload Aug 12 01:40:24.819965428 (80h14m46.779062676s) [upload=83647]: Done starting upload Aug 12 01:40:24.820095193 (80h14m46.779192431s) [upload=83647]: Uploading segments... Aug 12 01:40:24.820177936 (80h14m46.77927519s) [upload=83647]: Got next segment. Inline: true Aug 12 01:40:24.820185695 (80h14m46.779282941s) [upload=83647]: Waiting for error group managing segments... Aug 12 01:40:24.820246545 (80h14m46.77934379s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:40:24.820252044 (80h14m46.779349292s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:40:24.820255845 (80h14m46.77935309s) [upload=83647]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:40:24.909738609 (80h14m46.868835875s) [upload=83647]: Done uploading segments... Aug 12 01:40:24.909756439 (80h14m46.868853705s) [upload=83647]: Upload finished. err: metaclient: Too Many Requests
Duration: 392.798535ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
909.093837ms
FAIL (2025-08-12 01:38:35 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 909.197892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.498122308s
FAIL (2025-08-12 01:38:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.498151141s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.947288035s
FAIL (2025-08-12 01:37:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.947346824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
828.320887ms
FAIL (2025-08-12 01:37:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 828.356812ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
898.954131ms
FAIL (2025-08-12 01:37:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 899.002837ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.93394251s
FAIL (2025-08-12 01:37:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.933982815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.674286712s
FAIL (2025-08-12 01:36:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.674315539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
811.133375ms
FAIL (2025-08-12 01:36:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 811.180506ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.58785224s
FAIL (2025-08-12 01:36:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.587982707s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
871.226515ms
FAIL (2025-08-12 01:36:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 871.255261ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.475415166s
FAIL (2025-08-12 01:35:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.475447462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
881.730573ms
FAIL (2025-08-12 01:35:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 881.784702ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.563998308s
FAIL (2025-08-12 01:34:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.564037402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.405268847s
FAIL (2025-08-12 01:34:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f68c8ce92a1d70eb8cf65bee32a9526218b1b9bba1eef1b8e1e29a84d9b4fb05 != before 4ff3e6faaa984c2617b441ba016bd00816aae978ab652eb5c7e0c48d2889f0bc
======LOGS======
Aug 12 00:56:09.402932739 (79h30m31.362029988s) [upload=82881]: Starting upload
Aug 12 00:56:09.403028317 (79h30m31.362125736s) [upload=82881]: Done starting upload
Aug 12 00:56:09.403183259 (79h30m31.362280498s) [upload=82881]: Uploading segments...
Aug 12 00:56:09.403630717 (79h30m31.362727963s) [upload=82881]: Got next segment. Inline: false
Aug 12 00:56:09.403694929 (79h30m31.362792179s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 00:56:09.403701070 (79h30m31.362798318s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 00:56:09.625680350 (79h30m31.584777586s) [seg_pos={0 0}, upload=82881]: Begin upload segment...
Aug 12 00:56:09.625749849 (79h30m31.584847086s) [seg_pos={0 0}, upload=82881]: Done begin upload segment.
Aug 12 00:56:09.625793448 (79h30m31.584890726s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.625807541 (79h30m31.584904791s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626274697 (79h30m31.585371947s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626339399 (79h30m31.585436651s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626677490 (79h30m31.585774742s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.626769592 (79h30m31.585866843s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627140326 (79h30m31.586237573s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.627948286 (79h30m31.587045534s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.630461105 (79h30m31.589558358s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631515705 (79h30m31.59061296s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.631929058 (79h30m31.591026314s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632294252 (79h30m31.591391507s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.632724091 (79h30m31.591821348s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633112577 (79h30m31.592209832s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633512944 (79h30m31.5926102s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.633843011 (79h30m31.592940302s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634347777 (79h30m31.593445032s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:09.634817359 (79h30m31.593914619s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Uploading piece...
Aug 12 00:56:10.195026442 (79h30m32.154123698s) [upload=82881]: Next returned nil segment
Aug 12 00:56:10.195094096 (79h30m32.154191351s) [upload=82881]: Waiting for error group managing segments...
Aug 12 00:56:10.368077623 (79h30m32.327174878s) [noise=true , address=77.90.31.16:4758 , piece_id=INDVLXVYDYZD7W3NX6MC7HM65PMZHPAOQRAFDMCIA5KQ2XASC3QQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.375663235 (79h30m32.334760484s) [noise=true , address=104.36.82.8:4997 , piece_id=SYLTFQVECBWRX6IJQ3MWTJ4HI3M43AAPJ2EHTCHHFMJJM3RBIKHA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.381898733 (79h30m32.34099598s) [noise=true , address=104.36.82.2:4743 , piece_id=WQ2K674QMG4JXRLRJA76IQNWP2F2DR6IB2XKFQIR4EGW5NSNWQHQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.382644141 (79h30m32.341741387s) [noise=true , address=77.90.31.16:4759 , piece_id=APLS434RE3O4U5NODEZZ3S3IF5OH5KW4BOKZVLRUDGX62YAFIXCA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.384188516 (79h30m32.343285762s) [noise=true , address=77.90.31.18:4836 , piece_id=6MODDATKPKHCMTZRH5YQ3EJIGKNV5N7HZ2QIWQSMGZBTYZYAYOUA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.389586749 (79h30m32.348683995s) [noise=true , address=104.36.82.56:4230 , piece_id=VICVGF6W6BEGJ2L5NGELCL75VTUB2VTX3XBKQWBKW7IETQ5NHFSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.391558662 (79h30m32.350655909s) [noise=true , address=104.36.82.37:4657 , piece_id=ZZ56DSI2VLKY6KHKOO4ZVOTES37JXH32OAUMEFV2CWNGCMH74S2A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.393464890 (79h30m32.352562137s) [noise=true , address=104.36.82.17:4353 , piece_id=VALG6IVXXB7DBOLYXZGF7JX3L2ARQDSNQHYVWBY5GJOGXYJQH3XQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.403763501 (79h30m32.362860751s) [noise=true , address=104.36.82.39:4751 , piece_id=UMYUHCJXYFXHH65R3GTDEFVG7QCGE3LLU5K6A3AFWYUPRAXQNTJQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.416601122 (79h30m32.375698361s) [noise=true , address=104.36.82.59:4323 , piece_id=R5YY3QDIVUWRHBPGGOERZGY45QTP5H2GXDIJI73K6RU4KJFAIU3Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.524861302 (79h30m32.483958537s) [noise=true , address=104.36.82.61:4399 , piece_id=CTQF5M2GXHYHELJILX5LW7P5GRTDWGWENVV2NTBUAJ7NEI2UBUDQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.547031105 (79h30m32.506128346s) [noise=true , address=79.127.220.101:4068 , piece_id=XIL7H3OTW6OHDOPM4PQBVE5HEKRMY5FJCSFWKJ57XP5THNRDA4SQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.558555741 (79h30m32.517652972s) [noise=true , address=79.127.220.98:4399 , piece_id=DTTLJN3GFDGDVASGZJDPCSKINCNCW2KOGR2NCQEMAYNQWM7NEA2Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642388966 (79h30m32.601486213s) [noise=true , address=79.127.201.215:4327 , piece_id=JWIGGWOAMREFGKEEAJ4BK5BWMO4WM4ZJYHXU7NCIAOIIURPMDL6Q, seg_pos={0 0}, upload=82881]: Done uploading piece. err: <nil>
Aug 12 00:56:10.642431029 (79h30m32.601528274s) [seg_pos={0 0}, upload=82881]: Segment reached optimal threshold of 14 pieces.
Aug 12 00:56:10.642581939 (79h30m32.601679174s) [noise=true , address=64.49.13.140:4510 , piece_id=3V56GCYQX3RV7UJJQAEQGXY3YJ3K2IIAYOAFQTZSRE6L43TI4TSA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642625652 (79h30m32.601722892s) [noise=true , address=64.49.13.138:4481 , piece_id=YIL6J7AGEEAXMF6O76C3DBW6ZASJ46EJSZO4FHL5LR7DFIFEX6JA, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.642736110 (79h30m32.601833347s) [noise=true , address=193.149.164.143:4699 , piece_id=ZCDURFG6LGPE7RLA65KFLMKGEWZJFH7ATM3GWTU37PXK55T7JVMQ, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LncNSBhhreg9JTByJPSB7eGUEu88Eyd3jc9pg24VsEjp4FULq): protocol: expected piece hash; context canceled; EOF
Aug 12 00:56:10.643712543 (79h30m32.602809788s) [noise=true , address=104.36.82.20:4469 , piece_id=DWM6YUTG3X5UWEIQQI4OWF2QHUJPI3JXPSIQPMPNI7S5NFED7O6A, seg_pos={0 0}, upload=82881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1A6EEfrxXWy6k1Ki5UrjR5tKgRYsVXsSG9za2bQvKuejRpawHT): protocol: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39760->104.36.82.20:4469: use of closed network connection
Aug 12 00:56:10.643790894 (79h30m32.602888142s) [seg_pos={0 0}, upload=82881]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 00:56:10.644071756 (79h30m32.603169006s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 00:56:10.644085676 (79h30m32.603182934s) [upload=82881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 00:56:10.817704910 (79h30m32.776802165s) [upload=82881]: Done uploading segments...
Aug 12 00:56:10.817751543 (79h30m32.776848809s) [upload=82881]: Upload finished. err: <nil>
Duration: 2.405298632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
865.497641ms
FAIL (2025-08-12 01:34:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:50:54.253617265 (79h25m16.21271451s) [upload=82790]: Starting upload Aug 12 00:50:54.253704577 (79h25m16.212801822s) [upload=82790]: Done starting upload Aug 12 00:50:54.253820457 (79h25m16.212917693s) [upload=82790]: Uploading segments... Aug 12 00:50:54.253903508 (79h25m16.213000754s) [upload=82790]: Got next segment. Inline: true Aug 12 00:50:54.253963228 (79h25m16.213060475s) [upload=82790]: Waiting for error group managing segments... Aug 12 00:50:54.254035753 (79h25m16.213133s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:50:54.254042347 (79h25m16.2131396s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:50:54.254047024 (79h25m16.213144273s) [upload=82790]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:50:54.439898482 (79h25m16.398995714s) [upload=82790]: Done uploading segments... Aug 12 00:50:54.439919015 (79h25m16.399016246s) [upload=82790]: Upload finished. err: <nil>
Duration: 865.552237ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|