Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 838.878861ms FAIL (2025-08-07 17:32:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 838.913028ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.127864863s FAIL (2025-08-07 17:32:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.127897365s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X....................................................X..] duration: 2.607266416s FAIL (2025-08-07 17:32:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5b36bb795dcca7e27eede3aac8d81a32b9efbda903f18ba127320effaf8431af != before 9c095996441728a221a142e34f1cd1e6a86d539ce06b6f44a6d739859f735bce ======LOGS====== it Aug 7 17:29:56.689478056 (7h50m18.433534931s) [upload=8147]: Done uploading segments... Aug 7 17:29:56.689516384 (7h50m18.433573247s) [upload=8147]: Upload finished. err: <nil> Aug 7 17:30:42.874156568 (7h51m4.618213415s) [upload=8158]: Starting upload Aug 7 17:30:42.874219592 (7h51m4.618276452s) [upload=8158]: Done starting upload Aug 7 17:30:42.874542595 (7h51m4.618599441s) [upload=8158]: Uploading segments... Aug 7 17:30:42.874618736 (7h51m4.618675606s) [upload=8158]: Got next segment. Inline: false Aug 7 17:30:42.874692071 (7h51m4.618748954s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 17:30:42.874700008 (7h51m4.618756876s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:30:43.074656770 (7h51m4.818713639s) [seg_pos={0 0}, upload=8158]: Begin upload segment... Aug 7 17:30:43.074799480 (7h51m4.818856343s) [seg_pos={0 0}, upload=8158]: Done begin upload segment. Aug 7 17:30:43.074847716 (7h51m4.81890459s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.075633621 (7h51m4.819690485s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076207359 (7h51m4.820264229s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076711605 (7h51m4.820768476s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077309623 (7h51m4.821366496s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077970493 (7h51m4.822027363s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.078535007 (7h51m4.822591882s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079097234 (7h51m4.823154105s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079756326 (7h51m4.823813197s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080325044 (7h51m4.824381914s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080859047 (7h51m4.824915914s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.081383051 (7h51m4.825439921s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082076736 (7h51m4.826133606s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082557150 (7h51m4.826614017s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083191470 (7h51m4.827248343s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083812620 (7h51m4.827893645s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.084482935 (7h51m4.828539803s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.085102099 (7h51m4.829158968s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.681584111 (7h51m5.425640963s) [upload=8158]: Next returned nil segment Aug 7 17:30:43.681624247 (7h51m5.425681108s) [upload=8158]: Waiting for error group managing segments... Aug 7 17:30:43.838862743 (7h51m5.582919591s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.858942961 (7h51m5.602999811s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.864721375 (7h51m5.608778225s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868156120 (7h51m5.612212981s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868641591 (7h51m5.612698442s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.874631117 (7h51m5.618687964s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.876948830 (7h51m5.621005686s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.878364310 (7h51m5.62242116s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.918484955 (7h51m5.66254181s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.959509320 (7h51m5.703566181s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.068785758 (7h51m5.812842622s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.124205135 (7h51m5.868261986s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.164291301 (7h51m5.908348167s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359887759 (7h51m6.103944614s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359936656 (7h51m6.103993519s) [seg_pos={0 0}, upload=8158]: Segment reached optimal threshold of 14 pieces. Aug 7 17:30:44.360154538 (7h51m6.104211385s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZXmboR5Gw4Tw9zLrXxft5qJrFMK3vJdjYAE4Pxbe4mvgqogCQ): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360254163 (7h51m6.104311009s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360331160 (7h51m6.104388007s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360412949 (7h51m6.104469796s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360425482 (7h51m6.104482328s) [seg_pos={0 0}, upload=8158]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:30:44.360524801 (7h51m6.10458166s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:30:44.360529462 (7h51m6.104586309s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:30:44.693775331 (7h51m6.437832201s) [upload=8158]: Done uploading segments... Aug 7 17:30:44.693798345 (7h51m6.43785521s) [upload=8158]: Upload finished. err: <nil> Duration: 2.607369312s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 860.045191ms FAIL (2025-08-07 17:31:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 860.079486ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X....................................................X.] duration: 2.715479377s FAIL (2025-08-07 17:31:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5b36bb795dcca7e27eede3aac8d81a32b9efbda903f18ba127320effaf8431af != before 9c095996441728a221a142e34f1cd1e6a86d539ce06b6f44a6d739859f735bce ======LOGS====== it Aug 7 17:29:56.689478056 (7h50m18.433534931s) [upload=8147]: Done uploading segments... Aug 7 17:29:56.689516384 (7h50m18.433573247s) [upload=8147]: Upload finished. err: <nil> Aug 7 17:30:42.874156568 (7h51m4.618213415s) [upload=8158]: Starting upload Aug 7 17:30:42.874219592 (7h51m4.618276452s) [upload=8158]: Done starting upload Aug 7 17:30:42.874542595 (7h51m4.618599441s) [upload=8158]: Uploading segments... Aug 7 17:30:42.874618736 (7h51m4.618675606s) [upload=8158]: Got next segment. Inline: false Aug 7 17:30:42.874692071 (7h51m4.618748954s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 17:30:42.874700008 (7h51m4.618756876s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:30:43.074656770 (7h51m4.818713639s) [seg_pos={0 0}, upload=8158]: Begin upload segment... Aug 7 17:30:43.074799480 (7h51m4.818856343s) [seg_pos={0 0}, upload=8158]: Done begin upload segment. Aug 7 17:30:43.074847716 (7h51m4.81890459s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.075633621 (7h51m4.819690485s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076207359 (7h51m4.820264229s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076711605 (7h51m4.820768476s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077309623 (7h51m4.821366496s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077970493 (7h51m4.822027363s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.078535007 (7h51m4.822591882s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079097234 (7h51m4.823154105s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079756326 (7h51m4.823813197s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080325044 (7h51m4.824381914s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080859047 (7h51m4.824915914s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.081383051 (7h51m4.825439921s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082076736 (7h51m4.826133606s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082557150 (7h51m4.826614017s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083191470 (7h51m4.827248343s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083812620 (7h51m4.827893645s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.084482935 (7h51m4.828539803s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.085102099 (7h51m4.829158968s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.681584111 (7h51m5.425640963s) [upload=8158]: Next returned nil segment Aug 7 17:30:43.681624247 (7h51m5.425681108s) [upload=8158]: Waiting for error group managing segments... Aug 7 17:30:43.838862743 (7h51m5.582919591s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.858942961 (7h51m5.602999811s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.864721375 (7h51m5.608778225s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868156120 (7h51m5.612212981s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868641591 (7h51m5.612698442s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.874631117 (7h51m5.618687964s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.876948830 (7h51m5.621005686s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.878364310 (7h51m5.62242116s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.918484955 (7h51m5.66254181s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.959509320 (7h51m5.703566181s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.068785758 (7h51m5.812842622s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.124205135 (7h51m5.868261986s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.164291301 (7h51m5.908348167s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359887759 (7h51m6.103944614s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359936656 (7h51m6.103993519s) [seg_pos={0 0}, upload=8158]: Segment reached optimal threshold of 14 pieces. Aug 7 17:30:44.360154538 (7h51m6.104211385s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZXmboR5Gw4Tw9zLrXxft5qJrFMK3vJdjYAE4Pxbe4mvgqogCQ): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360254163 (7h51m6.104311009s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360331160 (7h51m6.104388007s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360412949 (7h51m6.104469796s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360425482 (7h51m6.104482328s) [seg_pos={0 0}, upload=8158]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:30:44.360524801 (7h51m6.10458166s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:30:44.360529462 (7h51m6.104586309s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:30:44.693775331 (7h51m6.437832201s) [upload=8158]: Done uploading segments... Aug 7 17:30:44.693798345 (7h51m6.43785521s) [upload=8158]: Upload finished. err: <nil> Duration: 2.715510397s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X....................................................X] duration: 3.037936857s FAIL (2025-08-07 17:30:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5b36bb795dcca7e27eede3aac8d81a32b9efbda903f18ba127320effaf8431af != before 9c095996441728a221a142e34f1cd1e6a86d539ce06b6f44a6d739859f735bce ======LOGS====== it Aug 7 17:29:56.689478056 (7h50m18.433534931s) [upload=8147]: Done uploading segments... Aug 7 17:29:56.689516384 (7h50m18.433573247s) [upload=8147]: Upload finished. err: <nil> Aug 7 17:30:42.874156568 (7h51m4.618213415s) [upload=8158]: Starting upload Aug 7 17:30:42.874219592 (7h51m4.618276452s) [upload=8158]: Done starting upload Aug 7 17:30:42.874542595 (7h51m4.618599441s) [upload=8158]: Uploading segments... Aug 7 17:30:42.874618736 (7h51m4.618675606s) [upload=8158]: Got next segment. Inline: false Aug 7 17:30:42.874692071 (7h51m4.618748954s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 17:30:42.874700008 (7h51m4.618756876s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:30:43.074656770 (7h51m4.818713639s) [seg_pos={0 0}, upload=8158]: Begin upload segment... Aug 7 17:30:43.074799480 (7h51m4.818856343s) [seg_pos={0 0}, upload=8158]: Done begin upload segment. Aug 7 17:30:43.074847716 (7h51m4.81890459s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.075633621 (7h51m4.819690485s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076207359 (7h51m4.820264229s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.076711605 (7h51m4.820768476s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077309623 (7h51m4.821366496s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.077970493 (7h51m4.822027363s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.078535007 (7h51m4.822591882s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079097234 (7h51m4.823154105s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.079756326 (7h51m4.823813197s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080325044 (7h51m4.824381914s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.080859047 (7h51m4.824915914s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.081383051 (7h51m4.825439921s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082076736 (7h51m4.826133606s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.082557150 (7h51m4.826614017s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083191470 (7h51m4.827248343s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.083812620 (7h51m4.827893645s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.084482935 (7h51m4.828539803s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.085102099 (7h51m4.829158968s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Uploading piece... Aug 7 17:30:43.681584111 (7h51m5.425640963s) [upload=8158]: Next returned nil segment Aug 7 17:30:43.681624247 (7h51m5.425681108s) [upload=8158]: Waiting for error group managing segments... Aug 7 17:30:43.838862743 (7h51m5.582919591s) [noise=true , address=104.36.82.36:4646 , piece_id=FXJVUHNO3PZ7HOJOBMWG3W3ZRHLH32F7YJIYHNRJS2TY2GXNCA3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.858942961 (7h51m5.602999811s) [noise=true , address=104.36.82.53:4130 , piece_id=RYBTMV7ZVVYPFZEKFR3JPDPPRXTF5SBYUBWJTRPHBOMSQ7GCDIQA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.864721375 (7h51m5.608778225s) [noise=true , address=104.36.82.34:4575 , piece_id=EVO753OM3WCGF5MHM4GMXFPG6VK57GCYPZTSJR3DD7KIUS3RJIVA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868156120 (7h51m5.612212981s) [noise=true , address=104.36.82.62:4432 , piece_id=446FUX4D27M6DA2UKYX5SASXFQ5IJL77CUPSTPGBUUST75ZHXRFQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.868641591 (7h51m5.612698442s) [noise=true , address=104.36.82.9:4030 , piece_id=G2Y2BWKAZ3MVFM3MIHJVP2T2RT3BPJKB2CQCREZ7DCKRZL5KZUJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.874631117 (7h51m5.618687964s) [noise=true , address=104.36.82.37:4677 , piece_id=T5LEWYEHBSZTNG4QB6MN5M64HCBGBUY6ZI2HQAYFB6MKVL6ARLJQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.876948830 (7h51m5.621005686s) [noise=true , address=104.36.82.61:4387 , piece_id=7SS7TUD4MALGGMVUXMIHWA3O7BDZQS2YMZ2DP7Z6J54MIRSDU23Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.878364310 (7h51m5.62242116s) [noise=true , address=104.36.82.62:4425 , piece_id=MNKJIJWC53LQSIQLCHUDPCES6VZRBGE2VXW4TCI4KKWSODQFLV3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.918484955 (7h51m5.66254181s) [noise=true , address=45.91.116.8:4055 , piece_id=4EXVXUHPYOJKUU4354QWYG6OOVFETE2L26F7EZLNJCJJ5NCJ7O5A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:43.959509320 (7h51m5.703566181s) [noise=true , address=104.36.82.56:4251 , piece_id=VUERXUGNWGGNARO4GGAKR7CIWIXJVQO44NLKGJDCY2OFUF7SWP3A, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.068785758 (7h51m5.812842622s) [noise=true , address=104.36.82.60:4360 , piece_id=MFZTXCW5W3UQX2OMXUKKNFEMYZIQ5362Q5VXSSC47KAFH7B5O76Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.124205135 (7h51m5.868261986s) [noise=true , address=79.127.201.214:4295 , piece_id=AS5GU5I5UXAEHSHAWR6P4KMVX47243D2EUL27NLTCVK7ERA64DPQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.164291301 (7h51m5.908348167s) [noise=true , address=79.127.201.215:4347 , piece_id=AM3FGMFVTA2UAJASF5OKFBUKYISS2ON5Z3Y2BJ2ZATS3YZYSZ67Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359887759 (7h51m6.103944614s) [noise=true , address=64.49.13.26:4946 , piece_id=IZGMDEQPCGKY5DDIHLFU5NVIKBUYE3THR4VZASVQJGJEX7TCAZ7Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: <nil> Aug 7 17:30:44.359936656 (7h51m6.103993519s) [seg_pos={0 0}, upload=8158]: Segment reached optimal threshold of 14 pieces. Aug 7 17:30:44.360154538 (7h51m6.104211385s) [noise=true , address=79.127.205.233:4623 , piece_id=YHPV6HBJN5QN5DVO5SS2DR65IQRHOS7BDREJFQQKSEBLZCIH5IYA, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZXmboR5Gw4Tw9zLrXxft5qJrFMK3vJdjYAE4Pxbe4mvgqogCQ): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360254163 (7h51m6.104311009s) [noise=true , address=64.49.13.140:4506 , piece_id=HRZ75SMRNVOKA2WADT657WROTFETAFJLRM2GB2DVTNED6SWNQSIQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LYkWHxg4uodPG98gJ66uz34YjsBN9N3iiy6rWQpnLjhiKoCoW): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360331160 (7h51m6.104388007s) [noise=true , address=64.49.13.169:4710 , piece_id=YLL7A4LMGTUJC3KWINPZGRUXLQEX3IHJWT26OJRCH4SVKZP3OUNQ, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360412949 (7h51m6.104469796s) [noise=true , address=64.49.13.139:4469 , piece_id=6YEOGB2PPL4H2KIMVPTGZROQI5BXWYNKUR6AFUQRNAYUHX5TDY3Q, seg_pos={0 0}, upload=8158]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: expected piece hash; context canceled; EOF Aug 7 17:30:44.360425482 (7h51m6.104482328s) [seg_pos={0 0}, upload=8158]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:30:44.360524801 (7h51m6.10458166s) [upload=8158]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:30:44.360529462 (7h51m6.104586309s) [upload=8158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:30:44.693775331 (7h51m6.437832201s) [upload=8158]: Done uploading segments... Aug 7 17:30:44.693798345 (7h51m6.43785521s) [upload=8158]: Upload finished. err: <nil> Duration: 3.037976853s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 867.141921ms FAIL (2025-08-07 17:30:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 867.252269ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.444099001s FAIL (2025-08-07 17:29:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.444129703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 829.968557ms FAIL (2025-08-07 17:29:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 829.98715ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.438151293s FAIL (2025-08-07 17:29:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.438182629s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.........X.................................................] duration: 1.014215418s FAIL (2025-08-07 17:28:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.014247947s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.978786967s FAIL (2025-08-07 17:28:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.97882941s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.65682674s FAIL (2025-08-07 17:27:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.656863139s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.........X................................................] duration: 953.504331ms FAIL (2025-08-07 17:27:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 953.537055ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.821802001s FAIL (2025-08-07 17:27:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.821831827s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.539759497s FAIL (2025-08-07 17:26:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.539788509s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.........X...............................................] duration: 863.578541ms FAIL (2025-08-07 17:26:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 863.60763ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 3.215222249s FAIL (2025-08-07 17:26:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 3.215252471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.........X..............................................] duration: 841.863753ms FAIL (2025-08-07 17:25:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 841.890542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X.........X.............................................] duration: 921.632027ms FAIL (2025-08-07 17:25:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 921.660289ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.575625596s FAIL (2025-08-07 17:25:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.575653635s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X.........X............................................] duration: 856.61287ms FAIL (2025-08-07 17:24:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 856.643818ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.51227699s FAIL (2025-08-07 17:24:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.512309287s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.066104147s FAIL (2025-08-07 17:23:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 3.066132431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X.........X...........................................] duration: 1.061200039s FAIL (2025-08-07 17:23:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.061236534s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.736455872s FAIL (2025-08-07 17:23:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.736512059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X.........X..........................................] duration: 996.164064ms FAIL (2025-08-07 17:22:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 996.224133ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X.........X.........................................] duration: 1.318357445s FAIL (2025-08-07 17:22:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.318384249s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.590647093s FAIL (2025-08-07 17:22:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.590742881s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.543377117s FAIL (2025-08-07 17:22:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.543414799s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X.........X........................................] duration: 852.29328ms FAIL (2025-08-07 17:21:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 852.370907ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 3.316284022s FAIL (2025-08-07 17:21:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 3.316316336s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.663886326s FAIL (2025-08-07 17:20:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.663927476s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X.........X.......................................] duration: 853.463711ms FAIL (2025-08-07 17:20:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 853.492562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.619017076s FAIL (2025-08-07 17:19:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.619050534s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X.........X......................................] duration: 874.490901ms FAIL (2025-08-07 17:19:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 874.510065ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.54593472s FAIL (2025-08-07 17:19:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.545967324s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X.........X.....................................] duration: 830.010381ms FAIL (2025-08-07 17:18:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 830.079807ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X.........X....................................] duration: 842.824464ms FAIL (2025-08-07 17:18:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 842.85368ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.......................X...................................] duration: 2.671240425s FAIL (2025-08-07 17:18:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.67127074s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X.........X...................................] duration: 1.214988649s FAIL (2025-08-07 17:17:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.21503393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X.........X..................................] duration: 950.152714ms FAIL (2025-08-07 17:16:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 950.189717ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.......................X..................................] duration: 2.673208051s FAIL (2025-08-07 17:16:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.673261466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.......................X.................................] duration: 2.79221076s FAIL (2025-08-07 17:16:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.792247459s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X.........X.................................] duration: 1.096921202s FAIL (2025-08-07 17:15:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.096966031s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.......................X................................] duration: 2.374313449s FAIL (2025-08-07 17:15:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.374342014s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X.........X................................] duration: 868.286445ms FAIL (2025-08-07 17:15:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 868.331356ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.......................X...............................] duration: 2.523605242s FAIL (2025-08-07 17:14:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.523701496s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X.........X...............................] duration: 871.797272ms FAIL (2025-08-07 17:13:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 871.853412ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.......................X..............................] duration: 2.427699605s FAIL (2025-08-07 17:13:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 7 16:53:26.964916168 (7h13m48.708973028s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:53:26.964921624 (7h13m48.708978485s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:53:27.182888207 (7h13m48.926945057s) [seg_pos={0 0}, upload=7523]: Begin upload segment... Aug 7 16:53:27.182948141 (7h13m48.927004992s) [seg_pos={0 0}, upload=7523]: Done begin upload segment. Aug 7 16:53:27.182988861 (7h13m48.927045724s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183581330 (7h13m48.927638195s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.183893015 (7h13m48.927949879s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184179783 (7h13m48.928236646s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184431606 (7h13m48.928488468s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184765825 (7h13m48.928822684s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.184849038 (7h13m48.928905898s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185332883 (7h13m48.929389746s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.185782174 (7h13m48.929839034s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186204870 (7h13m48.930261742s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.186577077 (7h13m48.930633944s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187148152 (7h13m48.931205015s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.187872025 (7h13m48.931928886s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.188610810 (7h13m48.932667678s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.189259487 (7h13m48.93331635s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190101550 (7h13m48.934158413s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.190459788 (7h13m48.934516662s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.191101883 (7h13m48.935158747s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Uploading piece... Aug 7 16:53:27.763516705 (7h13m49.507573555s) [upload=7523]: Next returned nil segment Aug 7 16:53:27.763536567 (7h13m49.507593419s) [upload=7523]: Waiting for error group managing segments... Aug 7 16:53:27.922266221 (7h13m49.666323072s) [noise=true , address=104.36.82.16:4310 , piece_id=2JHPEXHNVZGPU2FXT53OC74VTTYA7LYHKX6MMVXE27RBPKNSZWEQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.925574904 (7h13m49.669631751s) [noise=true , address=104.36.82.43:4864 , piece_id=QNRBN7RR4FQECW4DERYYQQVQH5I67FDMPFPPQ6VT3OF6LZLROC6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.931754328 (7h13m49.675811188s) [noise=true , address=45.91.116.13:4160 , piece_id=JBISDCETJQVE2DKJQUGBP3B2YXZOJGHJYTSZEHTZTYCTADNYPQNA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933312503 (7h13m49.677369353s) [noise=true , address=104.36.82.23:4478 , piece_id=QWVZM3XFIQDR2DXX66FIWYCQBESI2VTUHG2WC3W4HQCNCGYGVW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.933778561 (7h13m49.677835411s) [noise=true , address=104.36.82.46:4516 , piece_id=7XDY7NWCHDLAM2BXKVCAEEH32WLLBHLAN3NDQP3EJOEB6EBY3YRQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.936898601 (7h13m49.68095545s) [noise=true , address=104.36.82.35:4607 , piece_id=2LJBDGYXHVQJGB2ZWYXK2VUVKPQIIS45P5W74Z32U2VRRJP6V5LQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.937458989 (7h13m49.681515847s) [noise=true , address=104.36.82.17:4331 , piece_id=ZGTX5DAO4JTMFWFHAUPUHWLF4ENR5FGSB6IK4GTZ2LJUKBWQNOMA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.953807750 (7h13m49.6978646s) [noise=true , address=104.36.82.50:4031 , piece_id=4OYKSRQD7UODZ6LNO3R4CRPEYXFYLZUWJLOAN6GPWOH7MYWAC57Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.954282552 (7h13m49.6983394s) [noise=true , address=104.36.82.44:4881 , piece_id=JESEK6D5V2TH6CG4G4T4JLYVUPBA25SHQHDBEFHKPR7LMMVPUI5Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957000276 (7h13m49.701057134s) [noise=true , address=104.36.82.55:4226 , piece_id=3KZ5SJMRGOIBZ7YHPGZCQ32KMVTSWVFXEVKSXSLWSBY5VH4I3EAQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.957864280 (7h13m49.70192113s) [noise=true , address=45.91.116.7:4028 , piece_id=QLSCB77VB7WUM4TL4KRTGHKPW4CXHICP3ZUOYMOVJU2C3TR4MT4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958398218 (7h13m49.702455069s) [noise=true , address=104.36.82.59:4305 , piece_id=TPTBN3KFXJ4DTMNKFNGUVZV5SC3SK2FPWLX5NWJL4IFDSSWJSW6Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:27.958818445 (7h13m49.702875292s) [noise=true , address=104.36.82.8:4993 , piece_id=UV6UKSVHGJQBHVW2RBVP5RDMLMLVUCRDDVMW7QBLPTROA7KLAI2Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005665213 (7h13m49.749722068s) [noise=true , address=104.36.82.58:4270 , piece_id=PBBDA3NK24G2KHOUHOM3AUNEI3SEQKQVPSZW72K7FAR3YEYKH6UA, seg_pos={0 0}, upload=7523]: Done uploading piece. err: <nil> Aug 7 16:53:28.005692260 (7h13m49.749749122s) [seg_pos={0 0}, upload=7523]: Segment reached optimal threshold of 14 pieces. Aug 7 16:53:28.023774469 (7h13m49.76783132s) [noise=true , address=45.91.116.14:4209 , piece_id=LWMT4JHI47SM25JCEQ6BWX7HQKT352XHJC5YLZ6Y2R2DJOE5JXNQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LWbAxsrDcyV31SxJNiVNYs7ERKAf6RTuKpE596UrYJAnXMndR): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024057657 (7h13m49.768114508s) [noise=true , address=104.36.82.60:4340 , piece_id=OOQ7O4PVAMA7ZKGUWIM2UWQOSATYWNROQZYS3NTGWK5UCOFNXMZQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 7 16:53:28.024235235 (7h13m49.768292081s) [noise=true , address=104.36.82.5:4870 , piece_id=AAPIKIKHOHAXWKHHJ22L763UPJMBKIUK4DYH2L43KOUEBTMWBSWQ, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MmdhnDp6kKktFb5btZUDeVQ2u3CNUKCZU7RfuEqiSQ2TEqwKX): protocol: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36492->104.36.82.5:4870: use of closed network connection Aug 7 16:53:28.024411579 (7h13m49.768468443s) [noise=true , address=79.127.205.233:4637 , piece_id=GLTZYWTCCAXCV2MZLNLDWVAQNKR2SCNMG7BTCAL7WW7SS3SVFF4Q, seg_pos={0 0}, upload=7523]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SBsYyN6EqA3ovHiGTt94EdF8kXFFXATRGLZjPjBfoPkPbFkEX): protocol: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43114->79.127.205.233:4637: use of closed network connection Aug 7 16:53:28.024431391 (7h13m49.768488254s) [seg_pos={0 0}, upload=7523]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:53:28.024550741 (7h13m49.7686076s) [upload=7523]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:53:28.024558230 (7h13m49.768615098s) [upload=7523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:53:28.264124025 (7h13m50.008180872s) [upload=7523]: Done uploading segments... Aug 7 16:53:28.264138271 (7h13m50.008195117s) [upload=7523]: Upload finished. err: <nil> Duration: 2.427733689s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)