Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.....X...................X.X....] duration:
2.342821958s
FAIL (2025-08-15 06:37:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.342858104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X..........X..............X....................XX.....] duration:
843.104573ms
FAIL (2025-08-15 06:37:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.136025ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X..........X..............X....................XX....] duration:
807.19511ms
FAIL (2025-08-15 06:37:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 807.247826ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X.....X...................X.X...] duration:
2.410638364s
FAIL (2025-08-15 06:37:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.41067101s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X..........X..............X....................XX...] duration:
837.160849ms
FAIL (2025-08-15 06:36:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 837.192988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X..........X..............X....................XX..] duration:
880.246788ms
FAIL (2025-08-15 06:36:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 880.285379ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.....X...................X.X..] duration:
2.371669541s
FAIL (2025-08-15 06:35:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.371702495s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X..........X..............X....................XX.] duration:
1.01912013s
FAIL (2025-08-15 06:35:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.019171706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............................X.....X...................X.X.] duration:
2.567440345s
FAIL (2025-08-15 06:35:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 2.567472055s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..........X..............X....................XX] duration:
381.500673ms
FAIL (2025-08-15 06:34:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:35.809204440 (157h8m57.768301678s) [upload=163689]: Starting upload Aug 15 06:34:35.809305667 (157h8m57.76840292s) [upload=163689]: Done starting upload Aug 15 06:34:35.809962543 (157h8m57.769059789s) [upload=163689]: Uploading segments... Aug 15 06:34:35.810173033 (157h8m57.769270279s) [upload=163689]: Got next segment. Inline: true Aug 15 06:34:35.810181629 (157h8m57.769278875s) [upload=163689]: Waiting for error group managing segments... Aug 15 06:34:35.810272251 (157h8m57.769369508s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:35.810284478 (157h8m57.769381726s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:35.810289163 (157h8m57.76938641s) [upload=163689]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:35.904931332 (157h8m57.864028584s) [upload=163689]: Done uploading segments... Aug 15 06:34:35.904952736 (157h8m57.864049989s) [upload=163689]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.529574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............................X.....X...................X.X] duration:
1.726326156s
FAIL (2025-08-15 06:34:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 15 06:34:17.290347000 (157h8m39.249444235s) [upload=163684]: Starting upload
Aug 15 06:34:17.290416952 (157h8m39.249514219s) [upload=163684]: Done starting upload
Aug 15 06:34:17.290602311 (157h8m39.249699543s) [upload=163684]: Uploading segments...
Aug 15 06:34:17.290949351 (157h8m39.25004667s) [upload=163684]: Got next segment. Inline: false
Aug 15 06:34:17.290997383 (157h8m39.250094634s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:34:17.291002888 (157h8m39.250100133s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:34:17.486210661 (157h8m39.445307897s) [seg_pos={0 0}, upload=163684]: Begin upload segment...
Aug 15 06:34:17.486282237 (157h8m39.445379475s) [seg_pos={0 0}, upload=163684]: Done begin upload segment.
Aug 15 06:34:17.486427709 (157h8m39.445524954s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.486539458 (157h8m39.445636693s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.487033846 (157h8m39.446131082s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489102429 (157h8m39.448199684s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.489782961 (157h8m39.448880212s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490385676 (157h8m39.449482924s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.490887335 (157h8m39.449984586s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.491520236 (157h8m39.450617525s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492195791 (157h8m39.45129304s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.492869991 (157h8m39.451967241s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.493476375 (157h8m39.452573653s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.495157639 (157h8m39.454254892s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.502772122 (157h8m39.461869377s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.505558428 (157h8m39.464655683s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.509953381 (157h8m39.469050635s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.512955221 (157h8m39.472052466s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.514897127 (157h8m39.473994372s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:17.518485650 (157h8m39.477582901s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Uploading piece...
Aug 15 06:34:18.053823712 (157h8m40.012920969s) [upload=163684]: Next returned nil segment
Aug 15 06:34:18.053843906 (157h8m40.01294114s) [upload=163684]: Waiting for error group managing segments...
Aug 15 06:34:18.186258986 (157h8m40.145356243s) [noise=true , address=77.90.31.12:4603 , piece_id=O22BBHLD4YJ7HPD2VSAMBX6M4TSHV2TXBKDUDGSEVPCHGJYUH33Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.196700243 (157h8m40.155797493s) [noise=true , address=77.90.31.10:4523 , piece_id=C3YA6H2VEUJSRIH76YADJQFKPIEYRBAF54WY4KXI2F3GELUM5C2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.200841778 (157h8m40.15993901s) [noise=true , address=77.90.31.19:4867 , piece_id=SOFZPLFVBHOT7ECS5U2T75ZWGSQURTLRQWLMZ3N3TQM7SJ6WL6KA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.207389923 (157h8m40.166487155s) [noise=true , address=104.36.82.34:4576 , piece_id=DY3E2NSRT57ZFFYX27KZNNL5Y7W56MOGP24H7TEDFO76EWXPT2QA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.214052915 (157h8m40.173150153s) [noise=true , address=104.36.82.50:4040 , piece_id=5OHGD43EHJF2OXVT6KOXX533ECP5SSMHJ2HSRE3LITMEUXLR2WTQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220672505 (157h8m40.179769752s) [noise=true , address=77.90.31.21:4898 , piece_id=UFEVQZ2L7MPAFD7E4IBYSENOFAYUYDCRUIOXVFHHEYLZGSMPUNUA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.220931449 (157h8m40.180028701s) [noise=true , address=104.36.82.23:4465 , piece_id=TQTPLJPP3WTTBZBJPJLEUCDEGVDPL3OB4KQ2VR456QKUQDPYXU4A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.232850111 (157h8m40.19194735s) [noise=true , address=104.36.82.17:4352 , piece_id=ZBMCW3C4ELNEKK3ERMPT5YMNCQTXKRYVG3U3W3RCDK7HANMRICUQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.243893390 (157h8m40.202990629s) [noise=true , address=104.36.82.39:4725 , piece_id=P4YK5NNNP7BVLN6IHNIT2AGFPMDW75XEBLZULTO7GM5LYFMCH7QQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.259913685 (157h8m40.219010923s) [noise=true , address=104.36.82.58:4281 , piece_id=R5GJ6MUCPHXHMEWVITVBSDZI2JSKYGZSWF52VTGC2MPRYCGH6Y7A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263799434 (157h8m40.222896673s) [noise=true , address=104.36.82.40:4942 , piece_id=HH3BY4NA5RQZD3PLU6BVGVOBVZISHGLPKCCHUQLHW4H3RNZYAP4Q, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.263914834 (157h8m40.223012072s) [noise=true , address=104.36.82.59:4328 , piece_id=C2ZK6QJC5ZBXY4Q2N7LPQHFNGXIOSOH3VD5HG2NEOPCXLR2LULSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.265143074 (157h8m40.224240306s) [noise=true , address=104.36.82.5:4871 , piece_id=JZI5HAJV2MVJNUU6GMAKTLH2KBWDTACEQ34O7746MZZA6HSUVHDA, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.288967193 (157h8m40.248064447s) [noise=true , address=104.36.82.60:4366 , piece_id=UFAB42JARABOUBZRDA67X5FGFQIUV6AFCKVK6UTU5XH2EL4X7GSQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: <nil>
Aug 15 06:34:18.289001124 (157h8m40.248098393s) [seg_pos={0 0}, upload=163684]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:34:18.289206008 (157h8m40.248303253s) [noise=true , address=79.127.201.215:4353 , piece_id=K7QKIFPZOH2PWDDK6YW6ITSUVFM2MZYMFVOI6DW5JJUPXD337KFQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227Uk4K8hmXrae9npcgjziCNhwfdfdDPdgEryAy5beiFaSmd1W): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289315230 (157h8m40.248412485s) [noise=true , address=104.36.82.44:4887 , piece_id=PRZ6LCA55Z2QC46KDOC25DYKO4KSH3HOO274H2NAPSMYZYJQUSLQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1orvhuWfkUGCykWsS2E5sHtMcEW3fFcCNzTQ4xSxqdhUrBza8H): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289378139 (157h8m40.248475376s) [noise=true , address=66.23.193.175:4562 , piece_id=YZM2PDJMLMX2XGMAT4JJ5JQFU7XGGIVKDRDIXUETZFUOXWY7E5VQ, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41164->66.23.193.175:4562: use of closed network connection
Aug 15 06:34:18.289468162 (157h8m40.248565408s) [noise=true , address=79.127.220.101:4059 , piece_id=Y34TWMW2RV5TJFM2KRLWP5K6BJVIVRXCDDFUOZR2LC5KDOGZAP2A, seg_pos={0 0}, upload=163684]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NYsfhMGTypvTJ25PU3x6t2oYmfXkmPjh5A2WPp3De7T78GEZZ): protocol: expected piece hash; context canceled; EOF
Aug 15 06:34:18.289487391 (157h8m40.248584646s) [seg_pos={0 0}, upload=163684]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:34:18.289620102 (157h8m40.248717357s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:34:18.289626451 (157h8m40.248723704s) [upload=163684]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:34:18.438897465 (157h8m40.397994698s) [upload=163684]: Done uploading segments...
Aug 15 06:34:18.438917638 (157h8m40.39801487s) [upload=163684]: Upload finished. err: <nil>
Duration: 1.726356437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X..........X..............X....................X] duration:
459.317996ms
FAIL (2025-08-15 06:34:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:34:15.084349121 (157h8m37.043446366s) [upload=163683]: Starting upload Aug 15 06:34:15.084430720 (157h8m37.043527957s) [upload=163683]: Done starting upload Aug 15 06:34:15.084510091 (157h8m37.043607335s) [upload=163683]: Uploading segments... Aug 15 06:34:15.084564756 (157h8m37.043662012s) [upload=163683]: Got next segment. Inline: true Aug 15 06:34:15.084572360 (157h8m37.043669603s) [upload=163683]: Waiting for error group managing segments... Aug 15 06:34:15.084626078 (157h8m37.043723328s) [upload=163683]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:34:15.084632514 (157h8m37.043729756s) [upload=163683]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:34:15.084638955 (157h8m37.043736205s) [upload=163683]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:34:15.266263756 (157h8m37.225361032s) [upload=163683]: Done uploading segments... Aug 15 06:34:15.266304663 (157h8m37.225401912s) [upload=163683]: Upload finished. err: metaclient: Too Many Requests
Duration: 459.362555ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........X..............X....................] duration:
816.371403ms
FAIL (2025-08-15 06:33:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 816.411447ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X.....X...................X.] duration:
2.373563274s
FAIL (2025-08-15 06:33:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:32:50.742028057 (157h7m12.701125306s) [upload=163660]: Starting upload Aug 15 06:32:50.742095897 (157h7m12.701193134s) [upload=163660]: Done starting upload Aug 15 06:32:50.742290075 (157h7m12.701387309s) [upload=163660]: Uploading segments... Aug 15 06:32:50.742486818 (157h7m12.701584065s) [upload=163660]: Got next segment. Inline: false Aug 15 06:32:50.742556945 (157h7m12.701654191s) [upload=163660]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:32:50.742564524 (157h7m12.701661773s) [upload=163660]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 06:32:50.831592776 (157h7m12.790690034s) [upload=163660]: Next segment err: metaclient: Too Many Requests Aug 15 06:32:50.831628525 (157h7m12.790725774s) [upload=163660]: Done uploading segments... Aug 15 06:32:50.831648685 (157h7m12.790745937s) [upload=163660]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.373600066s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.....X...................X] duration:
362.626925ms
FAIL (2025-08-15 06:32:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:32:50.742028057 (157h7m12.701125306s) [upload=163660]: Starting upload Aug 15 06:32:50.742095897 (157h7m12.701193134s) [upload=163660]: Done starting upload Aug 15 06:32:50.742290075 (157h7m12.701387309s) [upload=163660]: Uploading segments... Aug 15 06:32:50.742486818 (157h7m12.701584065s) [upload=163660]: Got next segment. Inline: false Aug 15 06:32:50.742556945 (157h7m12.701654191s) [upload=163660]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:32:50.742564524 (157h7m12.701661773s) [upload=163660]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 15 06:32:50.831592776 (157h7m12.790690034s) [upload=163660]: Next segment err: metaclient: Too Many Requests Aug 15 06:32:50.831628525 (157h7m12.790725774s) [upload=163660]: Done uploading segments... Aug 15 06:32:50.831648685 (157h7m12.790745937s) [upload=163660]: Upload finished. err: metaclient: Too Many Requests
Duration: 362.652377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........X..............X...................] duration:
825.39581ms
FAIL (2025-08-15 06:32:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 825.431062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.....X...................] duration:
2.395711727s
FAIL (2025-08-15 06:32:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.395743534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.....X..................] duration:
2.833540685s
FAIL (2025-08-15 06:32:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.833578314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........X..............X..................] duration:
1.30049463s
FAIL (2025-08-15 06:32:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 1.300543023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.....X.................] duration:
2.511365935s
FAIL (2025-08-15 06:31:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.511395089s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..........X..............X.................] duration:
1.047466714s
FAIL (2025-08-15 06:31:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 1.047503755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.....X................] duration:
2.35989751s
FAIL (2025-08-15 06:30:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.359935881s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........X..............X................] duration:
828.434751ms
FAIL (2025-08-15 06:30:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 828.465196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.....X...............] duration:
2.435129234s
FAIL (2025-08-15 06:30:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.435173838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........X..............X...............] duration:
946.544667ms
FAIL (2025-08-15 06:29:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 946.580413ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.....X..............] duration:
2.617865169s
FAIL (2025-08-15 06:28:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.617900625s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........X..............X..............] duration:
840.364969ms
FAIL (2025-08-15 06:28:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 840.446472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.....X.............] duration:
2.60063699s
FAIL (2025-08-15 06:28:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.600711567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X..............X.............] duration:
870.45736ms
FAIL (2025-08-15 06:28:11 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 870.504415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration:
2.765598322s
FAIL (2025-08-15 06:27:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.765707038s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X..............X............] duration:
814.053485ms
FAIL (2025-08-15 06:26:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 814.087525ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X..........X..............X...........] duration:
1.050994183s
FAIL (2025-08-15 06:26:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 1.051043566s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration:
2.375397673s
FAIL (2025-08-15 06:26:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.375433323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.....X..........] duration:
2.33075834s
FAIL (2025-08-15 06:25:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.330789628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X......................X..........X..............X..........] duration:
881.763302ms
FAIL (2025-08-15 06:25:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 881.794519ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...........................................X.....X.........] duration:
2.630648464s
FAIL (2025-08-15 06:25:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.63073088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X......................X..........X..............X.........] duration:
843.8862ms
FAIL (2025-08-15 06:25:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 843.996463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...........................................X.....X........] duration:
2.386629694s
FAIL (2025-08-15 06:24:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.386660405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X......................X..........X..............X........] duration:
832.761747ms
FAIL (2025-08-15 06:23:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 832.797071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...........................................X.....X.......] duration:
2.387563799s
FAIL (2025-08-15 06:23:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.387591624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X......................X..........X..............X.......] duration:
1.052244275s
FAIL (2025-08-15 06:23:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 1.052282127s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...........................................X.....X......] duration:
2.430412971s
FAIL (2025-08-15 06:22:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.430463348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X......................X..........X..............X......] duration:
837.166064ms
FAIL (2025-08-15 06:22:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 837.20357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X....X......................X..........X..............X.....] duration:
879.177726ms
FAIL (2025-08-15 06:22:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 879.209552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...........................................X.....X.....] duration:
2.604626271s
FAIL (2025-08-15 06:21:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.604658051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X....X......................X..........X..............X....] duration:
855.653513ms
FAIL (2025-08-15 06:21:32 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 855.687305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...........................................X.....X....] duration:
2.584734544s
FAIL (2025-08-15 06:21:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.584772499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X....X......................X..........X..............X...] duration:
836.259125ms
FAIL (2025-08-15 06:20:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 15 06:19:19.024117682 (156h53m40.983214933s) [upload=163416]: Starting upload Aug 15 06:19:19.024226108 (156h53m40.983323356s) [upload=163416]: Done starting upload Aug 15 06:19:19.024331519 (156h53m40.983428765s) [upload=163416]: Uploading segments... Aug 15 06:19:19.024390347 (156h53m40.983487601s) [upload=163416]: Got next segment. Inline: true Aug 15 06:19:19.024396084 (156h53m40.98349333s) [upload=163416]: Waiting for error group managing segments... Aug 15 06:19:19.024462883 (156h53m40.983560131s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:19:19.024468211 (156h53m40.983565463s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:19:19.024471907 (156h53m40.983569158s) [upload=163416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:19:19.164256265 (156h53m41.123353507s) [upload=163416]: Done uploading segments... Aug 15 06:19:19.164287999 (156h53m41.123385246s) [upload=163416]: Upload finished. err: <nil>
Duration: 836.292373ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...........................................X.....X...] duration:
2.41822935s
FAIL (2025-08-15 06:20:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 2.418262804s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...........................................X.....X..] duration:
3.118172103s
FAIL (2025-08-15 06:19:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 06:18:12.368340100 (156h52m34.327437355s) [upload=163400]: Starting upload
Aug 15 06:18:12.368422478 (156h52m34.327519735s) [upload=163400]: Done starting upload
Aug 15 06:18:12.368579252 (156h52m34.327676499s) [upload=163400]: Uploading segments...
Aug 15 06:18:12.368971760 (156h52m34.328069006s) [upload=163400]: Got next segment. Inline: false
Aug 15 06:18:12.369022669 (156h52m34.328119915s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:18:12.369029926 (156h52m34.328127171s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:18:12.564646612 (156h52m34.523743864s) [seg_pos={0 0}, upload=163400]: Begin upload segment...
Aug 15 06:18:12.564740766 (156h52m34.523838013s) [seg_pos={0 0}, upload=163400]: Done begin upload segment.
Aug 15 06:18:12.564779075 (156h52m34.523876329s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.564834908 (156h52m34.523932174s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565242232 (156h52m34.524339482s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565281775 (156h52m34.524379021s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565576095 (156h52m34.524673342s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565707851 (156h52m34.524805099s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.565992851 (156h52m34.525090101s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566073985 (156h52m34.525171233s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566343438 (156h52m34.525440685s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566523732 (156h52m34.525620997s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566724480 (156h52m34.525821726s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.566977900 (156h52m34.526075151s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567044618 (156h52m34.526141868s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567357002 (156h52m34.526454249s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567369696 (156h52m34.52646695s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567802146 (156h52m34.526899393s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.567964615 (156h52m34.527061865s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:12.568309053 (156h52m34.527406298s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Uploading piece...
Aug 15 06:18:13.106110706 (156h52m35.065207952s) [upload=163400]: Next returned nil segment
Aug 15 06:18:13.106128685 (156h52m35.065225934s) [upload=163400]: Waiting for error group managing segments...
Aug 15 06:18:13.273268160 (156h52m35.232365409s) [noise=true , address=77.90.31.17:4781 , piece_id=HLC7ZRR2YIH5QMM67LQDM3AY6TWEQ44YENZ4V6G4N4CFK4UBMSAA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276702168 (156h52m35.235799422s) [noise=true , address=77.90.31.14:4692 , piece_id=VRI6HA6WEQTXXA22X2DMLBMLLYRM3SF4FM6KXFIOFW5YCX4W36MQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.276975535 (156h52m35.236072786s) [noise=true , address=77.90.31.19:4875 , piece_id=KFLHF7EHUUMGCTAX6GGTJRVLRBPHCBNID4OYO3PTRELD4NW4JBLQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.288818110 (156h52m35.247915366s) [noise=true , address=77.90.31.10:4548 , piece_id=QXSO5NYEO7WXM5K7JTMSF4IXRBTJ5FMXOD2ALSJEMSWDSTOAJOBA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.291878949 (156h52m35.250976188s) [noise=true , address=104.36.82.22:4516 , piece_id=Q4P4IPYXRIS6DKXC5V76V7LYKVER57CUHW7MNJO54WVDRSFFKYAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.295969624 (156h52m35.255066879s) [noise=true , address=104.36.82.60:4345 , piece_id=RIQ2DJ62QG735XTTUR2Y55RI5CHJXP2GONM6PZFKWN7T2XZWLJDQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.302130405 (156h52m35.261227657s) [noise=true , address=104.36.82.34:4568 , piece_id=7PMKE4MR4ZVMLVYIVZOBTSL7XUGJPW2XOBAEFSMRETVDIVEBCHFQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.305463419 (156h52m35.264560668s) [noise=true , address=77.90.31.11:4586 , piece_id=F3AMLBVWBQ6OLZ27DASFQ7IKJQWKPK46VCD7ZEXS5FTX32D6AEAQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.321159131 (156h52m35.280256385s) [noise=true , address=104.36.82.58:4286 , piece_id=PDHWHOMQGDVNUBYXVYWSTDKWRA53VQV5W46NEKKBZM3KKZYFVUJQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.335604194 (156h52m35.294701448s) [noise=true , address=104.36.82.23:4477 , piece_id=NRKUTRRBAH6W5K25XKILODH4N3L7HNJKKWIM2XQBTS73QBPJDVNQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.345984346 (156h52m35.305081601s) [noise=true , address=104.36.82.10:4111 , piece_id=IJVSOYXNHB6DMCWP62SAEGJ4VZMWZY2OFBUW4LQ62LUAM4C3EMNA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.360193497 (156h52m35.319290743s) [noise=true , address=77.90.31.15:4719 , piece_id=C3KALQKKJDKCNX2BS3H55HA3GZYC62SW67RSUJB746LI5ZSAPOZQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.377024030 (156h52m35.336121282s) [noise=true , address=79.127.219.38:4016 , piece_id=FN6MINBOQLVOFVWKVIFP3GMC7ZJSNK5JVWCOM3EFMYNRUABOET4A, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388895623 (156h52m35.347992862s) [noise=true , address=104.36.82.35:4583 , piece_id=S5RJCNV6PFN5A6SR756AM4VZC33JSWOURYPUC64ZNKMPNMPTNLHA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: <nil>
Aug 15 06:18:13.388928896 (156h52m35.348026141s) [seg_pos={0 0}, upload=163400]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:18:13.389070117 (156h52m35.348167356s) [noise=true , address=79.127.220.98:4414 , piece_id=VPIDO47A2C2BFVMN7U7NUFFZH6H6VW27OTUBJ5GZQYY7H2DSCVYA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GzkAJNLdN9Tm5zbg6e9wM3NougmHFrRSigk34phhXifrinejm): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389153295 (156h52m35.34825054s) [noise=true , address=104.36.82.3:4773 , piece_id=QT7VI2KH3Y2NLLRYH3LWUC74G3PL2SNNZCIKEP4CZWPTNNMOT2TA, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RdN5fHVgcrtHFNS6AdzSgGavbtJntKXpEimi8Pvf2DPFPBPQV): protocol: expected piece hash; context canceled; EOF
Aug 15 06:18:13.389385485 (156h52m35.348482721s) [noise=true , address=79.127.201.215:4357 , piece_id=RQIHYU5JKC4YGV2PKOITFTPYAAIUMNGPMJK55NZXXT5FWRDTUOMQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yXKsyPEVG4W52L7SUmsDGt4oD2D9YyqsfwDVWpjMnMnyVo2Da): protocol: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49194->79.127.201.215:4357: use of closed network connection
Aug 15 06:18:13.389428437 (156h52m35.348525685s) [noise=true , address=104.36.82.5:4849 , piece_id=TL7NAOPSPXLUWYMLE7OOECB7PUFLABV7TU22CMHTLJXZAZPYM2IQ, seg_pos={0 0}, upload=163400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34804->104.36.82.5:4849: use of closed network connection
Aug 15 06:18:13.389450397 (156h52m35.348547642s) [seg_pos={0 0}, upload=163400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:18:13.389529139 (156h52m35.348626384s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:18:13.389533673 (156h52m35.348630918s) [upload=163400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:18:13.539225039 (156h52m35.49832229s) [upload=163400]: Done uploading segments...
Aug 15 06:18:13.539245721 (156h52m35.49834296s) [upload=163400]: Upload finished. err: <nil>
Duration: 3.118211299s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|