Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
2.0071787s
FAIL (2025-08-12 09:01:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 09:01:52.994104550 (87h36m14.953201806s) [upload=91307]: Starting upload
Aug 12 09:01:52.994187819 (87h36m14.953285057s) [upload=91307]: Done starting upload
Aug 12 09:01:52.994620683 (87h36m14.953717928s) [upload=91307]: Uploading segments...
Aug 12 09:01:52.994692675 (87h36m14.953789929s) [upload=91307]: Got next segment. Inline: false
Aug 12 09:01:52.994746236 (87h36m14.953843491s) [upload=91307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 09:01:52.994752634 (87h36m14.95384989s) [upload=91307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 09:01:53.254427787 (87h36m15.213525025s) [seg_pos={0 0}, upload=91307]: Begin upload segment...
Aug 12 09:01:53.254519949 (87h36m15.21361719s) [seg_pos={0 0}, upload=91307]: Done begin upload segment.
Aug 12 09:01:53.254587182 (87h36m15.213684455s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.254607999 (87h36m15.213705251s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.255142496 (87h36m15.214239743s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.255306088 (87h36m15.214403339s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.255777402 (87h36m15.214874651s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.256013774 (87h36m15.215111028s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.256229890 (87h36m15.215327147s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.256668744 (87h36m15.215765996s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.257110715 (87h36m15.216207961s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.259059268 (87h36m15.218156518s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.259576216 (87h36m15.218673457s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.260044627 (87h36m15.219141873s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.260469313 (87h36m15.219566563s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.260978557 (87h36m15.220075806s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.261335032 (87h36m15.220432279s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.261834423 (87h36m15.220931677s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.262350680 (87h36m15.221447938s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.265191390 (87h36m15.224288639s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Uploading piece...
Aug 12 09:01:53.840076338 (87h36m15.799173572s) [upload=91307]: Next returned nil segment
Aug 12 09:01:53.840101811 (87h36m15.799199086s) [upload=91307]: Waiting for error group managing segments...
Aug 12 09:01:53.981136758 (87h36m15.940234s) [noise=true , address=77.90.31.19:4850 , piece_id=DBPRIKZZS5SLUQBTPUO4K5TTAV24JBCXBA6NG3MBQ53552Z43KAQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:53.987161445 (87h36m15.946258685s) [noise=true , address=77.90.31.14:4679 , piece_id=PCWRO5U47AL4CHWPAJXITJGJKT476LWEB7UHA5IN3ZB2QB7MQ2WA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:53.994107634 (87h36m15.953204868s) [noise=true , address=104.36.82.23:4470 , piece_id=KHYSKS3HZ2MZGFFG76ES4GLO7HCU55LDZ4BH4KRPYXAG74PVPQDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:53.996102818 (87h36m15.955200056s) [noise=true , address=104.36.82.18:4381 , piece_id=OVBKQKL5PXUOJETI3SL6ZHBKXRGSILK5CQQV4AGH5XSTEHL2ZKQA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.010432952 (87h36m15.9695302s) [noise=true , address=104.36.82.8:4000 , piece_id=JQ5IFIRDN7UAW5G2MGGI4MAOWOK5TSRPUFITY63D2YKXDB23I7ZQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.014935556 (87h36m15.974032791s) [noise=true , address=104.36.82.17:4348 , piece_id=QBH5FRNE5HYWCDIJ54QA3VZ5SGSAOLBOHNYMJ2RT2XVLUC4RYTWQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.016685969 (87h36m15.975783215s) [noise=true , address=104.36.82.47:4517 , piece_id=UMXWA46BB6BMTQJBQDCFZPDOBYIGIJQ7EUZGL54IINLTX7C2J2DA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.016743050 (87h36m15.975840289s) [noise=true , address=104.36.82.46:4493 , piece_id=ISHRKJ3VK6GIVX42UUJZL6FPVNVCA73322UC5JNFPU2FGZME7XMA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.017243453 (87h36m15.976340692s) [noise=true , address=104.36.82.42:4832 , piece_id=43MXVKPTQLSFOXFRQSVS6M6S5KEZWIR2W33AUN4TY4TOR476CDRA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.020750379 (87h36m15.979847618s) [noise=true , address=104.36.82.36:4644 , piece_id=R3ZFUOOG6SYMWUVDKW5DT2GN426UPO2GJU5BZKXGIARLPFFFBYDQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.030169779 (87h36m15.989267033s) [noise=true , address=104.36.82.58:4270 , piece_id=PTXPGW4RKWOMNCFZPFWCI2724ICZ4VFN6GAJOLKP4SXHFN74JTPQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.031344846 (87h36m15.9904421s) [noise=true , address=104.36.82.23:4448 , piece_id=QAKRZRZUX4SH3QEUEHZMQVSG2B5IBSK6V6NSOVBCVHVPOPVE5PEQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.058067723 (87h36m16.01716496s) [noise=true , address=104.36.82.46:4494 , piece_id=WWQGK5QGAP6X2H4GIVBPJ7E3HFFARN2P2POWV3WAL3PECSXYEF2A, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.108120177 (87h36m16.067217425s) [noise=true , address=104.36.82.34:4563 , piece_id=E2IR7SE2J2Q5JOFQ66YXGSK3XYKRRGKRE2GB4DSDRAWPDJZUA33Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: <nil>
Aug 12 09:01:54.108153337 (87h36m16.067250585s) [seg_pos={0 0}, upload=91307]: Segment reached optimal threshold of 14 pieces.
Aug 12 09:01:54.108493578 (87h36m16.067590824s) [noise=true , address=64.49.13.155:4922 , piece_id=FHGUKLO3AETPD7W4YXC6HB4FNPKYDX4WYL43OTHHD65BFZGDYPUA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ckJ4ZkPjcb4ZiJ2EauhxsyBMNvGWaVeJxvmiFGYhbxiaLT5uy): protocol: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52424->64.49.13.155:4922: use of closed network connection
Aug 12 09:01:54.108539644 (87h36m16.067636879s) [noise=true , address=79.127.201.215:4354 , piece_id=6NOBEKSLL2VME7MVQMKXWQCPC6GFLANP6H6FEHZYH5WDDFN25U6Q, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13Jtv8kL5R9oVro2D4ioqsznoJBXyNgJLdj1FcrGN3WWH45rkP): protocol: expected piece hash; context canceled; EOF
Aug 12 09:01:54.108591714 (87h36m16.067688946s) [noise=true , address=64.49.13.137:4504 , piece_id=K4TAERVM7Z6W4LU4VQ3KJNMNEUZ66BUAKJPBCWD2YHS4X6TN6OMQ, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:11LnrSYf8ZaxUgsdjt6jHzNgHjkq1bFCnDEFd14JzhParNTesZ): protocol: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39768->64.49.13.137:4504: use of closed network connection
Aug 12 09:01:54.108598728 (87h36m16.067695969s) [noise=true , address=64.49.13.154:4926 , piece_id=EZ7DHFHE6VQ726TRLLW43YOCUHPARAIFU7SE2NSJ4HXELETRF6SA, seg_pos={0 0}, upload=91307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bpEYLHxV7TM3KdheTwmwBxpPvm3PKccMVFLfLc5fTXtJZX5VY): protocol: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43288->64.49.13.154:4926: use of closed network connection
Aug 12 09:01:54.108626348 (87h36m16.067723582s) [seg_pos={0 0}, upload=91307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 09:01:54.108715372 (87h36m16.067812607s) [upload=91307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 09:01:54.108720655 (87h36m16.0678179s) [upload=91307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 09:01:54.309402872 (87h36m16.268500108s) [upload=91307]: Done uploading segments...
Aug 12 09:01:54.309423775 (87h36m16.268521015s) [upload=91307]: Upload finished. err: <nil>
Duration: 2.007237366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration:
872.974661ms
FAIL (2025-08-12 09:01:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.01666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X........X......................] duration:
919.512388ms
FAIL (2025-08-12 09:01:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 919.608402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.937891132s
FAIL (2025-08-12 09:00:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.937925427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X........X.....................] duration:
872.011687ms
FAIL (2025-08-12 09:00:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 872.071537ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.518980057s
FAIL (2025-08-12 09:00:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 3.519023208s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X........X....................] duration:
827.658452ms
FAIL (2025-08-12 08:59:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 827.709463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.584068224s
FAIL (2025-08-12 08:59:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.584112135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.912035501s
FAIL (2025-08-12 08:58:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.912073329s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X........X...................] duration:
817.312833ms
FAIL (2025-08-12 08:58:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 817.42022ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.300021488s
FAIL (2025-08-12 08:57:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.300057333s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X........X..................] duration:
866.39856ms
FAIL (2025-08-12 08:57:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.445295ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.337592729s
FAIL (2025-08-12 08:57:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.337630129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X........X.................] duration:
832.879983ms
FAIL (2025-08-12 08:56:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.918636ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........X................] duration:
866.887566ms
FAIL (2025-08-12 08:56:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 866.934571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.489810607s
FAIL (2025-08-12 08:55:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.489844369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X........X...............] duration:
923.409837ms
FAIL (2025-08-12 08:55:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 923.447612ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.888598796s
FAIL (2025-08-12 08:55:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.888638117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X........X..............] duration:
1.071632658s
FAIL (2025-08-12 08:54:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.071672686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.582859225s
FAIL (2025-08-12 08:54:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.58290084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration:
818.826346ms
FAIL (2025-08-12 08:54:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.86147ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X........X............] duration:
818.853935ms
FAIL (2025-08-12 08:53:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 818.955686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.481544886s
FAIL (2025-08-12 08:53:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.481590214s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration:
1.244097217s
FAIL (2025-08-12 08:53:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.244144578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.208011441s
FAIL (2025-08-12 08:52:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 4.208047819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X........X..........] duration:
824.845064ms
FAIL (2025-08-12 08:52:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 824.885953ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.395872355s
FAIL (2025-08-12 08:51:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.395895001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
900.572578ms
FAIL (2025-08-12 08:51:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 900.618751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
884.437913ms
FAIL (2025-08-12 08:51:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.479944ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.416247145s
FAIL (2025-08-12 08:50:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.41628502s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
851.279378ms
FAIL (2025-08-12 08:50:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 851.321643ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.473335369s
FAIL (2025-08-12 08:49:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.473369449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
832.846154ms
FAIL (2025-08-12 08:49:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.878294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
844.983825ms
FAIL (2025-08-12 08:49:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.030177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.44717162s
FAIL (2025-08-12 08:48:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.447208551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.907076696s
FAIL (2025-08-12 08:47:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.907114936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
832.063465ms
FAIL (2025-08-12 08:47:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.091848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
852.407836ms
FAIL (2025-08-12 08:47:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.491765ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.254389848s
FAIL (2025-08-12 08:47:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.254419574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..] duration:
903.575448ms
FAIL (2025-08-12 08:46:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 903.666656ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.514381038s
FAIL (2025-08-12 08:46:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.51441407s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.] duration:
907.019309ms
FAIL (2025-08-12 08:46:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.057551ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.558721539s
FAIL (2025-08-12 08:45:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.558757213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X] duration:
448.286576ms
FAIL (2025-08-12 08:44:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 08:44:48.778687821 (87h19m10.737785078s) [upload=91019]: Starting upload Aug 12 08:44:48.778800602 (87h19m10.737897848s) [upload=91019]: Done starting upload Aug 12 08:44:48.778889635 (87h19m10.737986867s) [upload=91019]: Uploading segments... Aug 12 08:44:48.779004807 (87h19m10.738102061s) [upload=91019]: Got next segment. Inline: true Aug 12 08:44:48.779013101 (87h19m10.738110356s) [upload=91019]: Waiting for error group managing segments... Aug 12 08:44:48.779149409 (87h19m10.738246651s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:44:48.779158121 (87h19m10.738255378s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:44:48.779162594 (87h19m10.738259848s) [upload=91019]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:44:48.958011966 (87h19m10.917109218s) [upload=91019]: Done uploading segments... Aug 12 08:44:48.958034937 (87h19m10.917132189s) [upload=91019]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.31652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.463134329s
FAIL (2025-08-12 08:44:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.463189902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.612068928s
FAIL (2025-08-12 08:44:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.612100904s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.709338792s
FAIL (2025-08-12 08:43:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 1.709385009s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.468412413s
FAIL (2025-08-12 08:43:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.468447264s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.060037536s
FAIL (2025-08-12 08:42:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after f638f9e463a399b5e4bd8a29745117e2be2e7e211769c7cd4aae6d0f9b466d19 != before b427316b5031d407cb8e31f4738dd507a7ff392362839ad5014a83e396f2a6a6 ======LOGS====== Aug 12 08:37:24.476485002 (87h11m46.43558224s) [upload=90889]: Starting upload Aug 12 08:37:24.476542338 (87h11m46.435639575s) [upload=90889]: Done starting upload Aug 12 08:37:24.476629762 (87h11m46.435727006s) [upload=90889]: Uploading segments... Aug 12 08:37:24.476758152 (87h11m46.435855407s) [upload=90889]: Got next segment. Inline: true Aug 12 08:37:24.476766766 (87h11m46.435864022s) [upload=90889]: Waiting for error group managing segments... Aug 12 08:37:24.476841329 (87h11m46.435938593s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 08:37:24.476851258 (87h11m46.435948518s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 08:37:24.476855547 (87h11m46.435952795s) [upload=90889]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 08:37:34.746524878 (87h11m56.705622133s) [upload=90889]: Done uploading segments... Aug 12 08:37:34.746550137 (87h11m56.705647391s) [upload=90889]: Upload finished. err: <nil>
Duration: 1.06009191s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.675249339s
FAIL (2025-08-12 08:42:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 08:42:17.762841781 (87h16m39.721939026s) [upload=90974]: Starting upload
Aug 12 08:42:17.762950839 (87h16m39.722048084s) [upload=90974]: Done starting upload
Aug 12 08:42:17.763048833 (87h16m39.722146072s) [upload=90974]: Uploading segments...
Aug 12 08:42:17.763336309 (87h16m39.722433575s) [upload=90974]: Got next segment. Inline: false
Aug 12 08:42:17.763418330 (87h16m39.722515566s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 08:42:17.763513193 (87h16m39.722610456s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 08:42:17.978476395 (87h16m39.93757364s) [seg_pos={0 0}, upload=90974]: Begin upload segment...
Aug 12 08:42:17.978686770 (87h16m39.937784008s) [seg_pos={0 0}, upload=90974]: Done begin upload segment.
Aug 12 08:42:17.978738503 (87h16m39.937835751s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.981560533 (87h16m39.940657778s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982506486 (87h16m39.941603739s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982554210 (87h16m39.941651455s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.982884470 (87h16m39.941981719s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983178198 (87h16m39.942275443s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983316982 (87h16m39.94241423s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.983796277 (87h16m39.942893533s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984200385 (87h16m39.943297632s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984227005 (87h16m39.943324256s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984551629 (87h16m39.943648884s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.984992691 (87h16m39.944089946s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993429539 (87h16m39.952526794s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.993931639 (87h16m39.953028884s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997313460 (87h16m39.95641071s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.997708349 (87h16m39.956805594s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998068503 (87h16m39.957165748s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:17.998379651 (87h16m39.957476896s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Uploading piece...
Aug 12 08:42:18.571926716 (87h16m40.531023961s) [upload=90974]: Next returned nil segment
Aug 12 08:42:18.571938216 (87h16m40.531035465s) [upload=90974]: Waiting for error group managing segments...
Aug 12 08:42:18.709016779 (87h16m40.668114018s) [noise=true , address=77.90.31.19:4869 , piece_id=V4WXSDF55JGFQ7BVSOEYJFV3RAJZHV3IWLWP3CVTRI3Q26YW6WDQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.719605672 (87h16m40.678702917s) [noise=true , address=104.36.82.58:4295 , piece_id=OJECE7EUZE33MUZSRXSAVU7APJZXNNGE647ZJN426VMOWCPPXAVQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.737290113 (87h16m40.696387352s) [noise=true , address=77.90.31.15:4709 , piece_id=EEPM25CCDUDDT35PE6NCYU5Q6TWNOH6Q4KQ7R6RR5CPGWP2VNBEQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.740333406 (87h16m40.699430652s) [noise=true , address=104.36.82.17:4350 , piece_id=V6UQ576ML7HBV4CXEPU5P3YI4OGGZTCIS6WOEFJSVTE762IM6A3A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.741540962 (87h16m40.700638198s) [noise=true , address=104.36.82.13:4193 , piece_id=KVAX3XBMQSJGUGLA2FPIKX3XVRXMONDVUS2QULVDOBTGKOKZ2OCA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.746521755 (87h16m40.705618993s) [noise=true , address=104.36.82.62:4438 , piece_id=I6G4EC4SBNNS6CLFKFWTQ27A3DL44V5F4MOGRAEKQ5GLIR73SDLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.751909310 (87h16m40.711006548s) [noise=true , address=104.36.82.39:4748 , piece_id=IBOE6GKZUOSN3PLU2XKLXEQRUHPEZUTDX3DP7CTPONX6NXQSISMQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.753873822 (87h16m40.712971067s) [noise=true , address=104.36.82.58:4299 , piece_id=6ZDCZMQNA6FOSGDVCH4JEHVXL3C6SEKGGMPL44YFAYGP44S3HUQQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.757207668 (87h16m40.716304917s) [noise=true , address=104.36.82.46:4512 , piece_id=KWHJM5IKTWMGU3MYOP37KYE6CH3B5KYSZZYYLG6ONQ7AVQ3CLRGA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.763622084 (87h16m40.722719324s) [noise=true , address=104.36.82.60:4351 , piece_id=TWEXXAFONYF4JFGFFHIMV5BDUJ2YWR2JSY6L4WKX4JCPBNVXOCLQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.776299910 (87h16m40.735397145s) [noise=true , address=104.36.82.35:4602 , piece_id=LECBCNA23ALUVNIQFWMKTBPJHOQPKWJ57Z7WVKE5EHESBIHWF6EQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.783033228 (87h16m40.742130464s) [noise=true , address=77.90.31.11:4563 , piece_id=SPDHJUF2X45OJT46TDKGQEZ2RTJD2DKW4M4CT2QABULNGHB3JOZQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788305109 (87h16m40.747402356s) [noise=true , address=104.36.82.56:4237 , piece_id=HOECCPKM4HB4SDRKTJWJMTNPOYJ37VYZWNXEDTY76YR5CVMKIPEA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788471570 (87h16m40.747568807s) [noise=true , address=104.36.82.18:4389 , piece_id=ATMT4JAMVU6QZFY6NWFGAR372YIQWF77D7ZYDZN5TLKIJC47QVPA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: <nil>
Aug 12 08:42:18.788492056 (87h16m40.747589302s) [seg_pos={0 0}, upload=90974]: Segment reached optimal threshold of 14 pieces.
Aug 12 08:42:18.789013271 (87h16m40.748110517s) [noise=true , address=79.127.220.98:4413 , piece_id=B7XIECQD3TT6DUTEJNTZWUR4TXLKS6O6NSRMOTDTIUD5LBVZZ7XA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ot3pQG8jWjTnKDjiZuPQoXKnbpCgSPiVW1Ws8BfJk5L2Rmk8L): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789079682 (87h16m40.748176913s) [noise=true , address=64.49.13.26:4948 , piece_id=OHKZ5OJQYKYG4H5LR5NSR7QSLVXOKIJ5IBEHXX5XKVSZGKRZOUBQ, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nVV4rAAZRd4DcLsakTTyPRNWck7AjBA6StKvsVLH2dCKVkwHB): protocol: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34312->64.49.13.26:4948: use of closed network connection
Aug 12 08:42:18.789101414 (87h16m40.748198646s) [noise=true , address=104.36.82.44:4884 , piece_id=WW7LYOCHQHY3NEMUXVRVADADCLT3GIFZT5YMBC6GGDS7NHXEHSDA, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789172242 (87h16m40.748269473s) [noise=true , address=77.90.31.13:4660 , piece_id=C7PNZAC4UB4ZAZED7CURBL4YV3BCBGSJVOZ5PYRKXNCWN3W4AV6A, seg_pos={0 0}, upload=90974]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 12 08:42:18.789185187 (87h16m40.748282418s) [seg_pos={0 0}, upload=90974]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 08:42:18.789266599 (87h16m40.748363843s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 08:42:18.789270625 (87h16m40.748367856s) [upload=90974]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 08:42:19.939830514 (87h16m41.898927757s) [upload=90974]: Done uploading segments...
Aug 12 08:42:19.939940813 (87h16m41.899038063s) [upload=90974]: Upload finished. err: <nil>
Duration: 2.675307215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|