Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration:
2.43398665s
FAIL (2025-08-18 18:26:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.434020388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.........XX................................................] duration:
835.299684ms
FAIL (2025-08-18 18:26:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.736163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...X....................] duration:
2.639461624s
FAIL (2025-08-18 18:26:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.639499454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.........XX...............................................] duration:
2.145364756s
FAIL (2025-08-18 18:25:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.145419219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...X...................] duration:
2.455814472s
FAIL (2025-08-18 18:25:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.455852271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.........XX..............................................] duration:
1.135697701s
FAIL (2025-08-18 18:25:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.135729119s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.........XX.............................................] duration:
863.393739ms
FAIL (2025-08-18 18:24:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.523972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration:
2.877527674s
FAIL (2025-08-18 18:24:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.877565572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.........XX............................................] duration:
835.280576ms
FAIL (2025-08-18 18:23:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 835.328728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...X.................] duration:
2.591511062s
FAIL (2025-08-18 18:23:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.591639277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...X................] duration:
2.50435342s
FAIL (2025-08-18 18:23:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.504451307s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........XX...........................................] duration:
881.264582ms
FAIL (2025-08-18 18:22:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 881.297818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X...X...............] duration:
2.399167783s
FAIL (2025-08-18 18:22:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.399219283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.........XX..........................................] duration:
1.107234192s
FAIL (2025-08-18 18:21:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.107261622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration:
2.620514694s
FAIL (2025-08-18 18:21:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.620551354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........XX.........................................] duration:
850.055831ms
FAIL (2025-08-18 18:21:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 850.087601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration:
2.50158666s
FAIL (2025-08-18 18:20:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.501622719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.........XX........................................] duration:
925.493487ms
FAIL (2025-08-18 18:20:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 925.533231ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X...X............] duration:
2.512284856s
FAIL (2025-08-18 18:19:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.512318015s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........XX.......................................] duration:
918.578514ms
FAIL (2025-08-18 18:19:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 918.622485ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X...X...........] duration:
2.748263366s
FAIL (2025-08-18 18:18:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.748308357s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........XX......................................] duration:
831.333011ms
FAIL (2025-08-18 18:18:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 831.460441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration:
2.499859479s
FAIL (2025-08-18 18:18:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.499896518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration:
2.596204828s
FAIL (2025-08-18 18:17:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.596252824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........XX.....................................] duration:
856.207906ms
FAIL (2025-08-18 18:17:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.287522ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.........XX....................................] duration:
1.282536866s
FAIL (2025-08-18 18:17:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.28257538s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........XX...................................] duration:
1.014492918s
FAIL (2025-08-18 18:16:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014532414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X...X........] duration:
2.414590883s
FAIL (2025-08-18 18:16:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.414794442s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........XX..................................] duration:
911.613597ms
FAIL (2025-08-18 18:15:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 911.662779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X...X.......] duration:
2.748447117s
FAIL (2025-08-18 18:15:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.748490468s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X...X......] duration:
2.694333409s
FAIL (2025-08-18 18:15:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.694378873s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........XX.................................] duration:
868.65344ms
FAIL (2025-08-18 18:15:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 868.681675ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.........XX................................] duration:
1.001314929s
FAIL (2025-08-18 18:14:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.001355605s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration:
2.456262339s
FAIL (2025-08-18 18:14:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.456299449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X...X....] duration:
2.691696016s
FAIL (2025-08-18 18:13:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.691748969s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........XX...............................] duration:
855.57348ms
FAIL (2025-08-18 18:13:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 855.60452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X...X...] duration:
2.922159984s
FAIL (2025-08-18 18:13:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.92219017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration:
2.914444481s
FAIL (2025-08-18 18:12:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.914472181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........XX..............................] duration:
874.988421ms
FAIL (2025-08-18 18:12:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.034809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X...X.] duration:
2.79159734s
FAIL (2025-08-18 18:11:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 2.791665399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........XX.............................] duration:
883.598071ms
FAIL (2025-08-18 18:11:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.77258ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X...X] duration:
1.868833338s
FAIL (2025-08-18 18:11:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:11:05.148533592 (240h45m27.107630849s) [upload=250602]: Starting upload
Aug 18 18:11:05.148647910 (240h45m27.107745166s) [upload=250602]: Done starting upload
Aug 18 18:11:05.148771763 (240h45m27.107869012s) [upload=250602]: Uploading segments...
Aug 18 18:11:05.149270298 (240h45m27.108367532s) [upload=250602]: Got next segment. Inline: false
Aug 18 18:11:05.149349931 (240h45m27.108447181s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:11:05.149371589 (240h45m27.108468837s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:11:05.373120122 (240h45m27.332217363s) [seg_pos={0 0}, upload=250602]: Begin upload segment...
Aug 18 18:11:05.373221173 (240h45m27.332318429s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374054900 (240h45m27.333152156s) [seg_pos={0 0}, upload=250602]: Done begin upload segment.
Aug 18 18:11:05.374135204 (240h45m27.333232462s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374339326 (240h45m27.333436577s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374641923 (240h45m27.333739175s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.374727426 (240h45m27.333824692s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375027683 (240h45m27.334124918s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375094253 (240h45m27.334191497s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375424265 (240h45m27.334521522s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375522802 (240h45m27.334620057s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375739916 (240h45m27.334837177s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.375892226 (240h45m27.334989474s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376092442 (240h45m27.335189691s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376243762 (240h45m27.335341009s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376548565 (240h45m27.335645822s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376810287 (240h45m27.33590754s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.376920215 (240h45m27.336017474s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377166760 (240h45m27.336263997s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.377271654 (240h45m27.336368903s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Uploading piece...
Aug 18 18:11:05.953996277 (240h45m27.913093508s) [upload=250602]: Next returned nil segment
Aug 18 18:11:05.954013493 (240h45m27.913110741s) [upload=250602]: Waiting for error group managing segments...
Aug 18 18:11:06.096036742 (240h45m28.05513398s) [noise=true , address=104.36.82.49:4981 , piece_id=WEAXZD5Y2HBC25IVLKT4IM6YHBPMGUBLFM5Y62XIRE4Y2MECIKMA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.096964664 (240h45m28.056061915s) [noise=true , address=104.36.82.51:4073 , piece_id=H37SFA4Z64NPMWUHTH2NBNOPE2UJGHH4OMNXN232ZUAWOTWMLZIA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.099668120 (240h45m28.058765378s) [noise=true , address=45.91.116.10:4091 , piece_id=PFD562V2YNOERVMXAG6CR33NUGZL7QLKNAL67BKQHIXXRU2ILDYQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.119967146 (240h45m28.07906438s) [noise=true , address=77.90.31.17:4789 , piece_id=BVX74CZ6YTIHBXM545HJARO7Z3KCNDVI73Z6GDI5JARGD6GJTFHA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.129118610 (240h45m28.088215847s) [noise=true , address=104.36.82.18:4384 , piece_id=OINCOFTV3JH62UM3S5VH6EG5JS2QDEX526WTBURK67Q723Q5PLCA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.141832901 (240h45m28.100930152s) [noise=true , address=104.36.82.38:4693 , piece_id=KJ2UUOV63O45OHJK2RN57636AICUGSSDM2WBH3TCULCRP2FDQ24A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.155266923 (240h45m28.114364162s) [noise=true , address=45.91.116.14:4207 , piece_id=ZXK5CGVYSBJN62G5YMIR26LGBXHGA2CNHVQJFUJT5WSRMPQ5DENA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.171470327 (240h45m28.130567578s) [noise=true , address=45.91.116.5:4321 , piece_id=NDPE2LU5GAKR2FMQ64WFY66OI54HGBB4MUMQNXKI2RR7SJ62HKIQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.183510533 (240h45m28.142607765s) [noise=true , address=104.36.82.60:4342 , piece_id=4IK2GTC3AF7SO7O7TNVWUXIXNUFFCI6XG55NMGHYJLU32AO7ICGQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.224107946 (240h45m28.183205178s) [noise=true , address=104.36.82.7:4916 , piece_id=GDF2ZJQUKSMZ5FB6VHJVUVHM4HM5MQZ3JJCHUMIVEVDHD7LCW55Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.259327946 (240h45m28.218425191s) [noise=true , address=104.36.82.10:4091 , piece_id=NFE7OONXVO5LAFPOIY5EWF44IOD4X45KUGOX37T4IWIBEMAMAQ7A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.303387134 (240h45m28.262484381s) [noise=true , address=79.127.220.98:4420 , piece_id=MZXUQNWEIMUY76GD67GA5S7QEEXPAOQEWFHEO766WF2QV32IDQDQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.304148865 (240h45m28.263246111s) [noise=true , address=45.91.116.11:4121 , piece_id=GTBSNDTRBXFIJ33G5IKITGVCI4C7EMP3J4ZCT5KBCH6EIT7IOO3A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347288441 (240h45m28.306385687s) [noise=true , address=77.90.31.21:4908 , piece_id=423Q2RXSYBASQKP4IJEWO2G67Z6VYHIXQ25NK5HI5LO2NGHXEHWQ, seg_pos={0 0}, upload=250602]: Done uploading piece. err: <nil>
Aug 18 18:11:06.347331794 (240h45m28.30642904s) [seg_pos={0 0}, upload=250602]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:11:06.347550927 (240h45m28.306648183s) [noise=true , address=104.36.82.19:4419 , piece_id=NKFBE4QFUO7SX4BPHXJN5KFFSWG5HQNKDAZK5XN6HH7LIRCKRM6Q, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347667897 (240h45m28.306765132s) [noise=true , address=77.90.31.18:4830 , piece_id=S355NYTRRO6I5EDAAWUEQAJILSBNC5ZG7ICYIO6NUHMXHQ3JW3JA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12U2TBUpmxK1xeXXWHv1VNE8xgjQGU3MrcKsEmDRtPvpj2Tnddz): protocol: expected piece hash; context canceled; EOF
Aug 18 18:11:06.347690910 (240h45m28.30678816s) [noise=true , address=66.23.193.175:4558 , piece_id=X2D4VHEBHZPUL6QGSSWD7IWKTCHNYICWQCPYGVM6S5X4DA5GGA4A, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43798->66.23.193.175:4558: use of closed network connection
Aug 18 18:11:06.347832577 (240h45m28.306929811s) [noise=true , address=79.127.205.245:4223 , piece_id=CLAENZHLA6SA3XSDMTD7MSJVP2VVXDU3SMK5TGV3QEJ6GIPRBEWA, seg_pos={0 0}, upload=250602]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12inhTYZnzvZDkbu3c4TwZzR99b2KDsb1rFyq4E6i7YwMLLLLFS): protocol: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36534->79.127.205.245:4223: use of closed network connection
Aug 18 18:11:06.347859745 (240h45m28.30695698s) [seg_pos={0 0}, upload=250602]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:11:06.347938943 (240h45m28.307036178s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:11:06.347944330 (240h45m28.307041577s) [upload=250602]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:11:06.525715257 (240h45m28.484812495s) [upload=250602]: Done uploading segments...
Aug 18 18:11:06.525760324 (240h45m28.484857581s) [upload=250602]: Upload finished. err: <nil>
Duration: 1.86886195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.621849418s
FAIL (2025-08-18 18:10:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:09:03.953631629 (240h43m25.912728887s) [upload=250569]: Starting upload
Aug 18 18:09:03.953701744 (240h43m25.912799001s) [upload=250569]: Done starting upload
Aug 18 18:09:03.954161279 (240h43m25.913258537s) [upload=250569]: Uploading segments...
Aug 18 18:09:03.954295151 (240h43m25.91339241s) [upload=250569]: Got next segment. Inline: false
Aug 18 18:09:03.954346854 (240h43m25.913444115s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:09:03.954352736 (240h43m25.913449994s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:09:04.449307705 (240h43m26.40840499s) [seg_pos={0 0}, upload=250569]: Begin upload segment...
Aug 18 18:09:04.449393983 (240h43m26.408491236s) [seg_pos={0 0}, upload=250569]: Done begin upload segment.
Aug 18 18:09:04.449445358 (240h43m26.408542609s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450352073 (240h43m26.409449331s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450367905 (240h43m26.409465163s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450999612 (240h43m26.410096875s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451023360 (240h43m26.410120613s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451533035 (240h43m26.410630285s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451637126 (240h43m26.410734383s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451923104 (240h43m26.411020354s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.452273441 (240h43m26.411370691s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.453582395 (240h43m26.412679645s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.454143763 (240h43m26.413241013s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.455617960 (240h43m26.414715223s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456168992 (240h43m26.415266251s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456796558 (240h43m26.415893816s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.457741852 (240h43m26.416839102s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.458607019 (240h43m26.417704268s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.459755106 (240h43m26.418852377s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.467077667 (240h43m26.426174917s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:05.029649611 (240h43m26.988746862s) [upload=250569]: Next returned nil segment
Aug 18 18:09:05.029674622 (240h43m26.988771876s) [upload=250569]: Waiting for error group managing segments...
Aug 18 18:09:05.185762367 (240h43m27.144859604s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.192179269 (240h43m27.151276525s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.211707134 (240h43m27.170804367s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.223326864 (240h43m27.182424096s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.226564346 (240h43m27.185661586s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.228781293 (240h43m27.18787853s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.236649142 (240h43m27.195746387s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.242859236 (240h43m27.201956476s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.246507762 (240h43m27.205605009s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.257654352 (240h43m27.21675159s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.263468635 (240h43m27.222565867s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273268554 (240h43m27.232365791s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273311687 (240h43m27.232408924s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.275980271 (240h43m27.23507751s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.276010877 (240h43m27.235108124s) [seg_pos={0 0}, upload=250569]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:09:05.276241840 (240h43m27.23533908s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276652906 (240h43m27.235750155s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276871511 (240h43m27.235968756s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276930933 (240h43m27.236028172s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276948530 (240h43m27.236045768s) [seg_pos={0 0}, upload=250569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:09:05.277046555 (240h43m27.236143809s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:09:05.277052429 (240h43m27.236149679s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:09:05.699543480 (240h43m27.658640748s) [upload=250569]: Done uploading segments...
Aug 18 18:09:05.699587067 (240h43m27.658684299s) [upload=250569]: Upload finished. err: <nil>
Duration: 2.621902352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.........XX............................] duration:
1.23691911s
FAIL (2025-08-18 18:10:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.236968677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.54705344s
FAIL (2025-08-18 18:10:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:09:03.953631629 (240h43m25.912728887s) [upload=250569]: Starting upload
Aug 18 18:09:03.953701744 (240h43m25.912799001s) [upload=250569]: Done starting upload
Aug 18 18:09:03.954161279 (240h43m25.913258537s) [upload=250569]: Uploading segments...
Aug 18 18:09:03.954295151 (240h43m25.91339241s) [upload=250569]: Got next segment. Inline: false
Aug 18 18:09:03.954346854 (240h43m25.913444115s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:09:03.954352736 (240h43m25.913449994s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:09:04.449307705 (240h43m26.40840499s) [seg_pos={0 0}, upload=250569]: Begin upload segment...
Aug 18 18:09:04.449393983 (240h43m26.408491236s) [seg_pos={0 0}, upload=250569]: Done begin upload segment.
Aug 18 18:09:04.449445358 (240h43m26.408542609s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450352073 (240h43m26.409449331s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450367905 (240h43m26.409465163s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450999612 (240h43m26.410096875s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451023360 (240h43m26.410120613s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451533035 (240h43m26.410630285s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451637126 (240h43m26.410734383s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451923104 (240h43m26.411020354s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.452273441 (240h43m26.411370691s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.453582395 (240h43m26.412679645s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.454143763 (240h43m26.413241013s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.455617960 (240h43m26.414715223s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456168992 (240h43m26.415266251s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456796558 (240h43m26.415893816s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.457741852 (240h43m26.416839102s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.458607019 (240h43m26.417704268s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.459755106 (240h43m26.418852377s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.467077667 (240h43m26.426174917s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:05.029649611 (240h43m26.988746862s) [upload=250569]: Next returned nil segment
Aug 18 18:09:05.029674622 (240h43m26.988771876s) [upload=250569]: Waiting for error group managing segments...
Aug 18 18:09:05.185762367 (240h43m27.144859604s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.192179269 (240h43m27.151276525s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.211707134 (240h43m27.170804367s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.223326864 (240h43m27.182424096s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.226564346 (240h43m27.185661586s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.228781293 (240h43m27.18787853s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.236649142 (240h43m27.195746387s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.242859236 (240h43m27.201956476s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.246507762 (240h43m27.205605009s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.257654352 (240h43m27.21675159s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.263468635 (240h43m27.222565867s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273268554 (240h43m27.232365791s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273311687 (240h43m27.232408924s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.275980271 (240h43m27.23507751s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.276010877 (240h43m27.235108124s) [seg_pos={0 0}, upload=250569]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:09:05.276241840 (240h43m27.23533908s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276652906 (240h43m27.235750155s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276871511 (240h43m27.235968756s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276930933 (240h43m27.236028172s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276948530 (240h43m27.236045768s) [seg_pos={0 0}, upload=250569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:09:05.277046555 (240h43m27.236143809s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:09:05.277052429 (240h43m27.236149679s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:09:05.699543480 (240h43m27.658640748s) [upload=250569]: Done uploading segments...
Aug 18 18:09:05.699587067 (240h43m27.658684299s) [upload=250569]: Upload finished. err: <nil>
Duration: 2.547089795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.402337128s
FAIL (2025-08-18 18:09:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:09:03.953631629 (240h43m25.912728887s) [upload=250569]: Starting upload
Aug 18 18:09:03.953701744 (240h43m25.912799001s) [upload=250569]: Done starting upload
Aug 18 18:09:03.954161279 (240h43m25.913258537s) [upload=250569]: Uploading segments...
Aug 18 18:09:03.954295151 (240h43m25.91339241s) [upload=250569]: Got next segment. Inline: false
Aug 18 18:09:03.954346854 (240h43m25.913444115s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:09:03.954352736 (240h43m25.913449994s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:09:04.449307705 (240h43m26.40840499s) [seg_pos={0 0}, upload=250569]: Begin upload segment...
Aug 18 18:09:04.449393983 (240h43m26.408491236s) [seg_pos={0 0}, upload=250569]: Done begin upload segment.
Aug 18 18:09:04.449445358 (240h43m26.408542609s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450352073 (240h43m26.409449331s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450367905 (240h43m26.409465163s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450999612 (240h43m26.410096875s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451023360 (240h43m26.410120613s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451533035 (240h43m26.410630285s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451637126 (240h43m26.410734383s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451923104 (240h43m26.411020354s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.452273441 (240h43m26.411370691s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.453582395 (240h43m26.412679645s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.454143763 (240h43m26.413241013s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.455617960 (240h43m26.414715223s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456168992 (240h43m26.415266251s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456796558 (240h43m26.415893816s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.457741852 (240h43m26.416839102s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.458607019 (240h43m26.417704268s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.459755106 (240h43m26.418852377s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.467077667 (240h43m26.426174917s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:05.029649611 (240h43m26.988746862s) [upload=250569]: Next returned nil segment
Aug 18 18:09:05.029674622 (240h43m26.988771876s) [upload=250569]: Waiting for error group managing segments...
Aug 18 18:09:05.185762367 (240h43m27.144859604s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.192179269 (240h43m27.151276525s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.211707134 (240h43m27.170804367s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.223326864 (240h43m27.182424096s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.226564346 (240h43m27.185661586s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.228781293 (240h43m27.18787853s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.236649142 (240h43m27.195746387s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.242859236 (240h43m27.201956476s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.246507762 (240h43m27.205605009s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.257654352 (240h43m27.21675159s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.263468635 (240h43m27.222565867s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273268554 (240h43m27.232365791s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273311687 (240h43m27.232408924s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.275980271 (240h43m27.23507751s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.276010877 (240h43m27.235108124s) [seg_pos={0 0}, upload=250569]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:09:05.276241840 (240h43m27.23533908s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276652906 (240h43m27.235750155s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276871511 (240h43m27.235968756s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276930933 (240h43m27.236028172s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276948530 (240h43m27.236045768s) [seg_pos={0 0}, upload=250569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:09:05.277046555 (240h43m27.236143809s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:09:05.277052429 (240h43m27.236149679s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:09:05.699543480 (240h43m27.658640748s) [upload=250569]: Done uploading segments...
Aug 18 18:09:05.699587067 (240h43m27.658684299s) [upload=250569]: Upload finished. err: <nil>
Duration: 2.402387302s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.........XX...........................] duration:
1.435297185s
FAIL (2025-08-18 18:09:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.435402259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..........................................................X] duration:
3.193999181s
FAIL (2025-08-18 18:09:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 18:09:03.953631629 (240h43m25.912728887s) [upload=250569]: Starting upload
Aug 18 18:09:03.953701744 (240h43m25.912799001s) [upload=250569]: Done starting upload
Aug 18 18:09:03.954161279 (240h43m25.913258537s) [upload=250569]: Uploading segments...
Aug 18 18:09:03.954295151 (240h43m25.91339241s) [upload=250569]: Got next segment. Inline: false
Aug 18 18:09:03.954346854 (240h43m25.913444115s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 18:09:03.954352736 (240h43m25.913449994s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 18:09:04.449307705 (240h43m26.40840499s) [seg_pos={0 0}, upload=250569]: Begin upload segment...
Aug 18 18:09:04.449393983 (240h43m26.408491236s) [seg_pos={0 0}, upload=250569]: Done begin upload segment.
Aug 18 18:09:04.449445358 (240h43m26.408542609s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450352073 (240h43m26.409449331s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450367905 (240h43m26.409465163s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.450999612 (240h43m26.410096875s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451023360 (240h43m26.410120613s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451533035 (240h43m26.410630285s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451637126 (240h43m26.410734383s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.451923104 (240h43m26.411020354s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.452273441 (240h43m26.411370691s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.453582395 (240h43m26.412679645s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.454143763 (240h43m26.413241013s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.455617960 (240h43m26.414715223s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456168992 (240h43m26.415266251s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.456796558 (240h43m26.415893816s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.457741852 (240h43m26.416839102s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.458607019 (240h43m26.417704268s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.459755106 (240h43m26.418852377s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:04.467077667 (240h43m26.426174917s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Uploading piece...
Aug 18 18:09:05.029649611 (240h43m26.988746862s) [upload=250569]: Next returned nil segment
Aug 18 18:09:05.029674622 (240h43m26.988771876s) [upload=250569]: Waiting for error group managing segments...
Aug 18 18:09:05.185762367 (240h43m27.144859604s) [noise=true , address=45.91.116.9:4272 , piece_id=5GMXCWJMAGMMGICIE5MZMTS5P3LGC35GILA5XXH32LML4SHQXEMQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.192179269 (240h43m27.151276525s) [noise=true , address=45.91.116.5:4303 , piece_id=CHPXKKGOY4E6VULSIQ6B5XAQYAXLNJZECIVWVCG3PBTQB2K5BXHQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.211707134 (240h43m27.170804367s) [noise=true , address=77.90.31.11:4586 , piece_id=BAGPKNIFX4LVQ7N5NSKG4Z5XNM4BXJFDJZK3G2NO3YIURM5NIO4Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.223326864 (240h43m27.182424096s) [noise=true , address=104.36.82.37:4657 , piece_id=YHPNI3QEZ7GWEGOBUZHTROOHGXPCMRNE7UWSLTN6TNSOAPRQMRMA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.226564346 (240h43m27.185661586s) [noise=true , address=104.36.82.9:4014 , piece_id=RUT2YEAU6TIESJGON444WR4XHCEFX2ETTC7OLKZRGVS7YWWCX75A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.228781293 (240h43m27.18787853s) [noise=true , address=104.36.82.34:4574 , piece_id=TDGDSURN4HGR3OCKIQJ7FSU2X3VRB5JS5ODEREPRHEYDSQQ3K6FA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.236649142 (240h43m27.195746387s) [noise=true , address=104.36.82.4:4833 , piece_id=3WQO36IGDPJANNCABYBFXYPZDNXPPYLW3V5JXCUENMZBLRIGKG2A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.242859236 (240h43m27.201956476s) [noise=true , address=45.91.116.13:4157 , piece_id=KNOUNQFJEOYJ4MPI7JE45UEZU3DPPOXFVP37PX4HB3675BRG6ODA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.246507762 (240h43m27.205605009s) [noise=true , address=77.90.31.15:4717 , piece_id=VKL6NCE2VORLYGSSUBI46KX6Y5YN7I4SNUVMRIOV7J3UWXZM3D6A, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.257654352 (240h43m27.21675159s) [noise=true , address=104.36.82.20:4447 , piece_id=FAWEOMDLWYQZFFV7QMVFH2UYRDBFUTIZPW6GK7KXS36CQ5GHZHAQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.263468635 (240h43m27.222565867s) [noise=true , address=104.36.82.18:4378 , piece_id=M45246YCXVBVUYURSZKZ44ITQS5DT4KJK3JBQF7GBQVSI36ERSBQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273268554 (240h43m27.232365791s) [noise=true , address=77.90.31.13:4630 , piece_id=2OINYOLCE2ATZPRYPNIL645XXV653RG4ICSW2WSN6EME3YQXM47Q, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.273311687 (240h43m27.232408924s) [noise=true , address=104.36.82.38:4690 , piece_id=BSDN5QQMW6WJXSAX4LXWGMHV7OJ4WMZBN74IDBDOQL3XOSGFHSBA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.275980271 (240h43m27.23507751s) [noise=true , address=104.36.82.36:4629 , piece_id=CQT4NS7ZXPMVYEWRNGDF3JLILXA6ACX7MMLDGCZO2NCW7ZWDJ3AQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: <nil>
Aug 18 18:09:05.276010877 (240h43m27.235108124s) [seg_pos={0 0}, upload=250569]: Segment reached optimal threshold of 14 pieces.
Aug 18 18:09:05.276241840 (240h43m27.23533908s) [noise=true , address=104.36.82.8:4999 , piece_id=3N3WXRM4X7GOBAIHV6QTYEC6WIW6S2HCC45KUNMKTOSBHM3W46VA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y993kGnB4JusXCcZ4KGyGpRBwoHksVBPzK77ePMw9G7djQEyY): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276652906 (240h43m27.235750155s) [noise=true , address=104.36.82.15:4288 , piece_id=ULEQARKWLOZQPB774NA5LIFS2DPH4NR5UMMMSKFSGIFPFFB2W7OQ, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gPjPGuueZnizLT2QvJN9y7riwKiW5TWMkQtmGGPP7VZvkNoB7): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276871511 (240h43m27.235968756s) [noise=true , address=77.90.31.17:4801 , piece_id=MVSYYO2QX2Z4YDHLCN726GM6Y67D7AE34GU2YFT6U22FGDAOHULA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276930933 (240h43m27.236028172s) [noise=true , address=104.36.82.60:4353 , piece_id=AHPS24JPUPNG5VZVL7VGNLC6HHW4I5QG3YC652H65XUQLMZFFTWA, seg_pos={0 0}, upload=250569]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 18 18:09:05.276948530 (240h43m27.236045768s) [seg_pos={0 0}, upload=250569]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 18:09:05.277046555 (240h43m27.236143809s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 18:09:05.277052429 (240h43m27.236149679s) [upload=250569]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 18:09:05.699543480 (240h43m27.658640748s) [upload=250569]: Done uploading segments...
Aug 18 18:09:05.699587067 (240h43m27.658684299s) [upload=250569]: Upload finished. err: <nil>
Duration: 3.194036401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.........XX..........................] duration:
865.506688ms
FAIL (2025-08-18 18:08:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 17:48:46.379119086 (240h23m8.338216345s) [upload=250212]: Starting upload Aug 18 17:48:46.379209635 (240h23m8.338306889s) [upload=250212]: Done starting upload Aug 18 17:48:46.379299381 (240h23m8.338396627s) [upload=250212]: Uploading segments... Aug 18 17:48:46.379361393 (240h23m8.338459036s) [upload=250212]: Got next segment. Inline: true Aug 18 17:48:46.379370841 (240h23m8.338468099s) [upload=250212]: Waiting for error group managing segments... Aug 18 17:48:46.379433416 (240h23m8.338530669s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 17:48:46.379442031 (240h23m8.338539285s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 17:48:46.379447842 (240h23m8.338545107s) [upload=250212]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 17:48:46.470418605 (240h23m8.429515864s) [upload=250212]: Done uploading segments... Aug 18 17:48:46.470474306 (240h23m8.429571581s) [upload=250212]: Upload finished. err: metaclient: Too Many Requests
Duration: 865.538477ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.399427616s
FAIL (2025-08-18 18:08:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 18 17:23:40.161057602 (239h58m2.120154855s) [upload=249778]: Starting upload
Aug 18 17:23:40.161131351 (239h58m2.120228598s) [upload=249778]: Done starting upload
Aug 18 17:23:40.161245539 (239h58m2.120342784s) [upload=249778]: Uploading segments...
Aug 18 17:23:40.161559232 (239h58m2.120656482s) [upload=249778]: Got next segment. Inline: false
Aug 18 17:23:40.161643484 (239h58m2.120740737s) [upload=249778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 17:23:40.161650431 (239h58m2.12074768s) [upload=249778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 17:23:40.371573723 (239h58m2.330670976s) [seg_pos={0 0}, upload=249778]: Begin upload segment...
Aug 18 17:23:40.371648447 (239h58m2.330745685s) [seg_pos={0 0}, upload=249778]: Done begin upload segment.
Aug 18 17:23:40.371696966 (239h58m2.330794218s) [noise=true , address=104.36.82.15:4287 , piece_id=JYITUTQXMBQ3DTWXSQCAIRZKC2722T3JCDHFHZIXDAO5VVM3SOIQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.372350118 (239h58m2.331447369s) [noise=true , address=45.91.116.5:4320 , piece_id=R5UPC76HYSTGCOFBT5XROTP7LKGAMDNTVKWTBZX3P3EUJH6VEBZQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.372470622 (239h58m2.331567879s) [noise=true , address=77.90.31.19:4875 , piece_id=URSPMGUHF3X2QGZQFXKJZO5APCQHG42H6LGFTARBSATV5UKQFI3Q, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.373056407 (239h58m2.332153651s) [noise=true , address=45.91.116.14:4198 , piece_id=5JBRVHX3OPU7QXS23WXEAVAMKYTKMMYMYC6NWAU5LOLKDHPTZIAA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.373243182 (239h58m2.332340433s) [noise=true , address=77.90.31.17:4795 , piece_id=VZCEBT4QB2CTUXO3Q26FSKZMVYGIWME3QYFID5XPROV5BLVTJLZA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.373803118 (239h58m2.332900369s) [noise=true , address=104.36.82.18:4392 , piece_id=7YKRQS7D4INY627SU54BCBJ5LAACZX75UKVJHOUOPURSMRHYURJQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.374264399 (239h58m2.333361649s) [noise=true , address=104.36.82.35:4594 , piece_id=BTB3RLHG6TPURPD4Z4LG2AUV3FRMDX4L4AFYF2IWTR4QBQPPU7FA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.374650628 (239h58m2.333747884s) [noise=true , address=77.90.31.13:4636 , piece_id=4WGZPTCLYXI32LML5S2YGKTV76QJ6FQTMSLJTZJPUA7HEJMKDOLA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.375032220 (239h58m2.334129466s) [noise=true , address=104.36.82.39:4732 , piece_id=BXMSZSXP5BOGAC2CYHYUG3I2LDEH35Z7KJWB7I2LE34DNNQ54KTQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.375371502 (239h58m2.334468747s) [noise=true , address=77.90.31.12:4619 , piece_id=DYSZQY3FG5D4TP7J7WWEWJ6QLII7WGB6O5HFZZQJ5CTPSDJAYSVQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.375751414 (239h58m2.334848665s) [noise=true , address=104.36.82.44:4872 , piece_id=J6CA6CUYBNUPXLH7RUKMHST3V7TXLVJ5MB2MTP3T5FY2MUOPUMMA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.376169013 (239h58m2.335266264s) [noise=true , address=104.36.82.14:4253 , piece_id=3VDN7TP7QUJTOXKDGE3T4ZPZ2FYBWP6LVAYZ2H5VAMXLROFEVLFQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.376630140 (239h58m2.335727394s) [noise=true , address=104.36.82.23:4458 , piece_id=D6RZGJW3RHZ5NJFBNNCKXO4JO6EU5YIPQXA2VFN2O4COWNRTZZTQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.376973282 (239h58m2.336070527s) [noise=true , address=45.91.116.13:4172 , piece_id=Q5GLKBYJUDNEY2QV2FHFCJLYZJ4EBRKW3BOB7SWFQSKHQEI7BD3A, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.377337514 (239h58m2.336434777s) [noise=true , address=104.36.82.5:4857 , piece_id=6UBHDJ5X767RUK2JHZ5VALPCO4LF6X6UZCJUUUSZXB5NVC6Y2ETA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.377721237 (239h58m2.336818491s) [noise=true , address=104.36.82.60:4338 , piece_id=QSDHHBWETK6QUY57T2C7JNVQRUGENUNAB2DI2CF5FC6NXN4CS4XQ, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.378085793 (239h58m2.337183039s) [noise=true , address=104.36.82.58:4283 , piece_id=IQVRTHQZT3CKA5AE35ZBHUG5CCZOZU6SKJ6TIHHMBDZ7LLXJ52AA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.378359818 (239h58m2.337457063s) [noise=true , address=104.36.82.36:4629 , piece_id=GWGKF5CJUBALCO4WVDZNZMZHYPHX5YQJCIN67FO3QJJJ53NVRLMA, seg_pos={0 0}, upload=249778]: Uploading piece...
Aug 18 17:23:40.948452060 (239h58m2.907549299s) [upload=249778]: Next returned nil segment
Aug 18 17:23:40.948470811 (239h58m2.907568046s) [upload=249778]: Waiting for error group managing segments...
Aug 18 17:23:41.106615462 (239h58m3.065712708s) [noise=true , address=104.36.82.23:4458 , piece_id=D6RZGJW3RHZ5NJFBNNCKXO4JO6EU5YIPQXA2VFN2O4COWNRTZZTQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.125537130 (239h58m3.084634369s) [noise=true , address=45.91.116.14:4198 , piece_id=5JBRVHX3OPU7QXS23WXEAVAMKYTKMMYMYC6NWAU5LOLKDHPTZIAA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.134271818 (239h58m3.093369058s) [noise=true , address=104.36.82.35:4594 , piece_id=BTB3RLHG6TPURPD4Z4LG2AUV3FRMDX4L4AFYF2IWTR4QBQPPU7FA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.145738274 (239h58m3.104835511s) [noise=true , address=104.36.82.18:4392 , piece_id=7YKRQS7D4INY627SU54BCBJ5LAACZX75UKVJHOUOPURSMRHYURJQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.161551163 (239h58m3.120648401s) [noise=true , address=45.91.116.5:4320 , piece_id=R5UPC76HYSTGCOFBT5XROTP7LKGAMDNTVKWTBZX3P3EUJH6VEBZQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.167483162 (239h58m3.126580408s) [noise=true , address=45.91.116.13:4172 , piece_id=Q5GLKBYJUDNEY2QV2FHFCJLYZJ4EBRKW3BOB7SWFQSKHQEI7BD3A, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.169455657 (239h58m3.128552903s) [noise=true , address=104.36.82.5:4857 , piece_id=6UBHDJ5X767RUK2JHZ5VALPCO4LF6X6UZCJUUUSZXB5NVC6Y2ETA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.170271712 (239h58m3.129368959s) [noise=true , address=104.36.82.44:4872 , piece_id=J6CA6CUYBNUPXLH7RUKMHST3V7TXLVJ5MB2MTP3T5FY2MUOPUMMA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.186313315 (239h58m3.14541056s) [noise=true , address=77.90.31.17:4795 , piece_id=VZCEBT4QB2CTUXO3Q26FSKZMVYGIWME3QYFID5XPROV5BLVTJLZA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.212242322 (239h58m3.171339569s) [noise=true , address=104.36.82.58:4283 , piece_id=IQVRTHQZT3CKA5AE35ZBHUG5CCZOZU6SKJ6TIHHMBDZ7LLXJ52AA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.283519919 (239h58m3.242617151s) [noise=true , address=104.36.82.15:4287 , piece_id=JYITUTQXMBQ3DTWXSQCAIRZKC2722T3JCDHFHZIXDAO5VVM3SOIQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.285578750 (239h58m3.244676005s) [noise=true , address=104.36.82.39:4732 , piece_id=BXMSZSXP5BOGAC2CYHYUG3I2LDEH35Z7KJWB7I2LE34DNNQ54KTQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.288647060 (239h58m3.247744306s) [noise=true , address=77.90.31.13:4636 , piece_id=4WGZPTCLYXI32LML5S2YGKTV76QJ6FQTMSLJTZJPUA7HEJMKDOLA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.289102482 (239h58m3.248199731s) [noise=true , address=77.90.31.12:4619 , piece_id=DYSZQY3FG5D4TP7J7WWEWJ6QLII7WGB6O5HFZZQJ5CTPSDJAYSVQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.289126609 (239h58m3.248223851s) [seg_pos={0 0}, upload=249778]: Segment reached optimal threshold of 14 pieces.
Aug 18 17:23:41.289354542 (239h58m3.248451789s) [noise=true , address=104.36.82.14:4253 , piece_id=3VDN7TP7QUJTOXKDGE3T4ZPZ2FYBWP6LVAYZ2H5VAMXLROFEVLFQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vJmwywMNTHh1ce5JGzbMiUBA3FijDecNEJ1TDU1Wyd4NWzA14): protocol: expected piece hash; context canceled; EOF
Aug 18 17:23:41.290475365 (239h58m3.249572597s) [noise=true , address=104.36.82.36:4629 , piece_id=GWGKF5CJUBALCO4WVDZNZMZHYPHX5YQJCIN67FO3QJJJ53NVRLMA, seg_pos={0 0}, upload=249778]: Done uploading piece. err: <nil>
Aug 18 17:23:41.303967228 (239h58m3.263064461s) [noise=true , address=104.36.82.60:4338 , piece_id=QSDHHBWETK6QUY57T2C7JNVQRUGENUNAB2DI2CF5FC6NXN4CS4XQ, seg_pos={0 0}, upload=249778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: expected piece hash; context canceled; EOF
Aug 18 17:23:41.304091276 (239h58m3.26318851s) [noise=true , address=77.90.31.19:4875 , piece_id=URSPMGUHF3X2QGZQFXKJZO5APCQHG42H6LGFTARBSATV5UKQFI3Q, seg_pos={0 0}, upload=249778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn): protocol: expected piece hash; context canceled; EOF
Aug 18 17:23:41.304104259 (239h58m3.263201494s) [seg_pos={0 0}, upload=249778]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 18 17:23:41.304177608 (239h58m3.263274854s) [upload=249778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 17:23:41.304181573 (239h58m3.26327882s) [upload=249778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 17:23:41.547115167 (239h58m3.506212419s) [upload=249778]: Done uploading segments...
Aug 18 17:23:41.547131963 (239h58m3.5062292s) [upload=249778]: Upload finished. err: <nil>
Duration: 2.399465665s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|