Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X............X..............................................] duration:
2.38491457s
FAIL (2025-08-18 03:12:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.384969829s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X............................X.......................] duration:
842.870306ms
FAIL (2025-08-18 03:12:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.90071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X............X.............................................] duration:
2.454642171s
FAIL (2025-08-18 03:11:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.454681198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.......X............................X......................] duration:
851.254266ms
FAIL (2025-08-18 03:11:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.283051ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X............................X.....................] duration:
808.3164ms
FAIL (2025-08-18 03:10:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 808.348472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X............X............................................] duration:
2.638458835s
FAIL (2025-08-18 03:10:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.638493373s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X............X...........................................] duration:
2.316789522s
FAIL (2025-08-18 03:09:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.316896703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X............................X....................] duration:
859.78019ms
FAIL (2025-08-18 03:09:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.910826ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X............................X...................] duration:
846.776363ms
FAIL (2025-08-18 03:09:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.813945ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X............X..........................................] duration:
2.3358491s
FAIL (2025-08-18 03:08:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.335878853s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X............................X..................] duration:
826.528773ms
FAIL (2025-08-18 03:08:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.557613ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X............X.........................................] duration:
2.469346921s
FAIL (2025-08-18 03:08:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.469385626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X............X........................................] duration:
2.564043041s
FAIL (2025-08-18 03:07:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.564073855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X............................X.................] duration:
815.232679ms
FAIL (2025-08-18 03:07:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 815.255713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X............X.......................................] duration:
2.41963713s
FAIL (2025-08-18 03:07:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.419727623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X............................X................] duration:
920.565124ms
FAIL (2025-08-18 03:06:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 920.671155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X............X......................................] duration:
2.264337374s
FAIL (2025-08-18 03:06:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.264367481s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X............X.....................................] duration:
2.374131932s
FAIL (2025-08-18 03:06:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.374170807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X............................X...............] duration:
865.650616ms
FAIL (2025-08-18 03:06:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.679063ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X............X....................................] duration:
2.348807308s
FAIL (2025-08-18 03:05:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.348835386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.......X............................X..............] duration:
826.818993ms
FAIL (2025-08-18 03:05:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 826.86203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..........X............X...................................] duration:
2.46834954s
FAIL (2025-08-18 03:04:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.468373311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......X............................X.............] duration:
866.706067ms
FAIL (2025-08-18 03:04:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.758363ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..........X............X..................................] duration:
2.442117619s
FAIL (2025-08-18 03:03:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.442161313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......X............................X............] duration:
1.05432857s
FAIL (2025-08-18 03:03:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.054360916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..........X............X.................................] duration:
2.41949867s
FAIL (2025-08-18 03:03:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.419527296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.......X............................X...........] duration:
817.134928ms
FAIL (2025-08-18 03:02:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.162556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..........X............X................................] duration:
2.302018578s
FAIL (2025-08-18 03:02:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.302071233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.......X............................X..........] duration:
1.002695733s
FAIL (2025-08-18 03:02:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.002725115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..........X............X...............................] duration:
2.483620542s
FAIL (2025-08-18 03:02:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.48365222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......X............................X.........] duration:
852.773984ms
FAIL (2025-08-18 03:01:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.806444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........X............X..............................] duration:
2.41666821s
FAIL (2025-08-18 03:01:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.416704685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......X............................X........] duration:
955.233691ms
FAIL (2025-08-18 03:00:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 955.265467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......X............................X.......] duration:
864.236569ms
FAIL (2025-08-18 03:00:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.274614ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..........X............X.............................] duration:
2.669098578s
FAIL (2025-08-18 03:00:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.669141324s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.......X............................X......] duration:
2.059676443s
FAIL (2025-08-18 02:59:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.059704701s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........X............X............................] duration:
2.483584479s
FAIL (2025-08-18 02:59:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.483632317s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......X............................X.....] duration:
1.023223763s
FAIL (2025-08-18 02:59:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.023256986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..........X............X...........................] duration:
2.440416149s
FAIL (2025-08-18 02:58:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.440454004s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......X............................X....] duration:
880.076458ms
FAIL (2025-08-18 02:58:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.107059ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........X............X..........................] duration:
2.327668941s
FAIL (2025-08-18 02:57:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.327704566s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........X............X.........................] duration:
2.381136018s
FAIL (2025-08-18 02:57:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.381177577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......X............................X...] duration:
918.779738ms
FAIL (2025-08-18 02:56:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 918.809834ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........X............X........................] duration:
2.358372323s
FAIL (2025-08-18 02:56:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.358408284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.......X............................X..] duration:
838.594588ms
FAIL (2025-08-18 02:56:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.793139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X..........X............X.......................] duration:
2.494207236s
FAIL (2025-08-18 02:55:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.494310169s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.......X............................X.] duration:
838.19598ms
FAIL (2025-08-18 02:55:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.243913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........X............X......................] duration:
2.337592917s
FAIL (2025-08-18 02:54:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.337650717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.......X............................X] duration:
358.205371ms
FAIL (2025-08-18 02:54:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:54:30.660073017 (225h28m52.619170253s) [upload=234712]: Starting upload Aug 18 02:54:30.660134595 (225h28m52.619231844s) [upload=234712]: Done starting upload Aug 18 02:54:30.660220063 (225h28m52.619317301s) [upload=234712]: Uploading segments... Aug 18 02:54:30.660274909 (225h28m52.619372163s) [upload=234712]: Got next segment. Inline: true Aug 18 02:54:30.660280062 (225h28m52.619377297s) [upload=234712]: Waiting for error group managing segments... Aug 18 02:54:30.660334071 (225h28m52.619431306s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:54:30.660339420 (225h28m52.619436655s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 02:54:30.660342935 (225h28m52.61944017s) [upload=234712]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 02:54:30.748961296 (225h28m52.708058544s) [upload=234712]: Done uploading segments... Aug 18 02:54:30.748984361 (225h28m52.708081608s) [upload=234712]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.229136ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X............X.....................] duration:
2.385182894s
FAIL (2025-08-18 02:54:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after f9a1884d9f34b60418678db3edbfc7b5b0773760ee57fc86265729c86045fa83 != before 31797eb3d5d2bf3f19a1b9354555ec8c5f1e10912a8694947ca8bd0097d07b20
======LOGS======
Aug 18 02:37:39.134979263 (225h12m1.094076515s) [upload=234417]: Starting upload
Aug 18 02:37:39.135064831 (225h12m1.094162077s) [upload=234417]: Done starting upload
Aug 18 02:37:39.135228712 (225h12m1.094325958s) [upload=234417]: Uploading segments...
Aug 18 02:37:39.135625874 (225h12m1.09472312s) [upload=234417]: Got next segment. Inline: false
Aug 18 02:37:39.135690989 (225h12m1.094788235s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:37:39.135698173 (225h12m1.094795422s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:37:39.337461479 (225h12m1.296558752s) [seg_pos={0 0}, upload=234417]: Begin upload segment...
Aug 18 02:37:39.337594492 (225h12m1.29669174s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338194465 (225h12m1.297291701s) [seg_pos={0 0}, upload=234417]: Done begin upload segment.
Aug 18 02:37:39.338232537 (225h12m1.297329787s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338270090 (225h12m1.297367338s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338920689 (225h12m1.298017941s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.338969245 (225h12m1.298066499s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.339596442 (225h12m1.298693692s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.340570878 (225h12m1.299668129s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342290466 (225h12m1.301387719s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342591269 (225h12m1.301688516s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.342876412 (225h12m1.301973661s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343170766 (225h12m1.302268012s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343476338 (225h12m1.302573584s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.343819506 (225h12m1.302916761s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344250170 (225h12m1.303347418s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344541877 (225h12m1.303639209s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.344830746 (225h12m1.303927992s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345097830 (225h12m1.304195065s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.345401573 (225h12m1.304498819s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Uploading piece...
Aug 18 02:37:39.906374987 (225h12m1.86547224s) [upload=234417]: Next returned nil segment
Aug 18 02:37:39.906392989 (225h12m1.865490255s) [upload=234417]: Waiting for error group managing segments...
Aug 18 02:37:40.040607924 (225h12m1.999705172s) [noise=true , address=45.91.116.9:4292 , piece_id=ZEPF4MU5IWJJOE2OEDQ4DZXHH5ZVVCL37LU5Z4QW6BQFQ2D7HAYQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.042491595 (225h12m2.001588855s) [noise=true , address=77.90.31.12:4597 , piece_id=N4XV3C3EHNXRXZ75AW2HWS7BZYZ6C5RGCWOSXHDC2YXWPEJTIGSQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.061722652 (225h12m2.02081989s) [noise=true , address=104.36.82.6:4887 , piece_id=66ITNCRON3T4NEHZ5KU77W2OIHU2YUBSPBNYYVBYYYLFH23LHP2A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.062452967 (225h12m2.021550206s) [noise=true , address=104.36.82.23:4452 , piece_id=LKRS46RAZC3B25CSSOXR75RSTABXR45NRSBCJBOW34XSGMYWWU3A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066351874 (225h12m2.02544911s) [noise=true , address=45.91.116.10:4086 , piece_id=YCRA7VD6QZLWSJKA7EHWV32AEK62V65KLEX3SBNVDSDJC4QFIWOQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.066799657 (225h12m2.025896909s) [noise=true , address=104.36.82.35:4584 , piece_id=TW4BW3KYXJNLS2WXGREV6WYEEPHRYJTDUR2HBEM7W3S74JINME3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.075500782 (225h12m2.034598029s) [noise=true , address=77.90.31.13:4648 , piece_id=AJKJUD5HRA27XXI43XJOOMRTRA5WBR3H5HSWLET5HEKMD4DFS7EA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.078084283 (225h12m2.037181531s) [noise=true , address=45.91.116.4:4946 , piece_id=GZXENI27YX6DHS7SC7LXQGAZ6QEX6K2EFGOKT4KPBEDHP3W3OB3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.079837203 (225h12m2.038934455s) [noise=true , address=104.36.82.8:4979 , piece_id=TKS74IDOGGEVR7HYV6Y5HHW3YIJYL3G7PWSJFLM5QKLQCHCXZTZQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.081056656 (225h12m2.040153891s) [noise=true , address=104.36.82.9:4036 , piece_id=FCSBIG3J7WK7KWAIKROIT5RC5V7GEPFM3ICPU3SO573RBXIPG7UQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.083945940 (225h12m2.04304319s) [noise=true , address=104.36.82.39:4736 , piece_id=AT7TPT6DS72ZNWOA7554P2IKP3LYTEV4Z3G7UK73ZCZCGQFNBTTQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.084823838 (225h12m2.043921076s) [noise=true , address=104.36.82.34:4557 , piece_id=G5XLRNQ3LIIAXTQE6GCELR2NXTO3CBRLM4ZCZ2PM4C3WUKVWJTMA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.091856946 (225h12m2.050954194s) [noise=true , address=104.36.82.38:4710 , piece_id=2J5Y7XI4M73IUBYQRQZPG7TX7L7ALB5KOYI4FO5QJKRX7O3LLFWA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092144871 (225h12m2.051242108s) [noise=true , address=104.36.82.13:4208 , piece_id=M5SEF55XGNCVVZL2PW7CDLSPKRDLF7763HGVER3H35CS7HVAC7VA, seg_pos={0 0}, upload=234417]: Done uploading piece. err: <nil>
Aug 18 02:37:40.092178754 (225h12m2.051276006s) [seg_pos={0 0}, upload=234417]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:37:40.092363817 (225h12m2.051461064s) [noise=true , address=104.36.82.3:4793 , piece_id=QZQD4PHV7OO76RGOOHOMWBLJGIJT6RJLY22CXGQTUGSIOYHTHS3Q, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CffFfbiSKKBGuksEnNL1NuVRjbkRdVUjoYMJisvUM6pEiaUgJ): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092464122 (225h12m2.051561355s) [noise=true , address=77.90.31.21:4904 , piece_id=N7CHY3VW3UHLDRY5B76BCCDHY5C2KP2WPSJM3O6WXHUQFE7K2O7A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092479708 (225h12m2.05157694s) [noise=true , address=104.36.82.17:4355 , piece_id=VZJYABS2QBICEBRD47E4CAHQFRQXJX3RMAX7CVEO7VUZJCFTM75A, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T): protocol: expected piece hash; context canceled; EOF
Aug 18 02:37:40.092546105 (225h12m2.051643351s) [noise=true , address=66.23.193.175:4561 , piece_id=ZG5DNUZER2KRWNFXELXBPRSICOI76VKFR6N5ADMELFPGV3LAPDVQ, seg_pos={0 0}, upload=234417]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43918->66.23.193.175:4561: use of closed network connection
Aug 18 02:37:40.092601096 (225h12m2.051698342s) [seg_pos={0 0}, upload=234417]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:37:40.092693118 (225h12m2.051790367s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:37:40.092699345 (225h12m2.051796598s) [upload=234417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:37:40.389187075 (225h12m2.34828433s) [upload=234417]: Done uploading segments...
Aug 18 02:37:40.389213754 (225h12m2.348310987s) [upload=234417]: Upload finished. err: <nil>
Duration: 2.385217613s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|